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To our parents 




Preface 


This book is about model reduction in kinetics. Is this physics or mathemat¬ 
ics? There are at least four reasonable answers to this question: 

- It is physics, it is not mathematics; 

- It is mathematics, it is not physics; 

- It is both physics and mathematics; 

It is neither physics, nor mathematics, it is something else (but what could 
that be?). 

Of course, it is physics. Model reduction in kinetics requires physical con¬ 
cepts and structures; it is impossible to make an expedient reduction of a ki¬ 
netic model without thermodynamics, for example. The entropy, the Legendre 
transformation generated by the entropy, and the Riemann structure defined 
by the second differential of the entropy provide the elementary geometrical 
basis for the first approximation. The physical sense of the models gives many 
hints for their further processing. So, it is not mathematics; we care about 
the physical sense more than about rigorous proofs. We should deal with 
equations even in the absence of theorems about existence and uniqueness of 
solutions. Mathematics assimilates the physical notions with a considerable 
delay in time, but any such an assimilation leads to further insights . 1 

But, without doubt, it is mathematics. The story about invariant man¬ 
ifolds for differential equations began inside mathematics. The first signifi¬ 
cant steps were taken by two great mathematicians, A.M. Lyapunov and H. 
Poincare, at the end of the XIXth century. Then N.M. Krylov and N.N. Bo- 
golyubov, A.N. Kolmogorov, V.I. Arnold and J. Moser, J.E. Marsden, M.I. 
Vishik, R. Temam, and many other mathematicians developed this field of 
science, and many elegant theorems and useful methods were created. This is 
not only pure mathematics, the wide field of applications was developed too, 
from hydrodynamics to process engineering and control theory and methods. 
This is pure and applied dynamics. The language of model reduction, the ba¬ 
sic notions that we use, the theorems and methods, all this either came from 


1 The closest example: after mathematicians discovered how the entropy functional 
may be important for the theory of the Boltzmann equation, then they proved 
the existence theorem (P.L. Lions and R. DiPerna, this work was awarded the 
Fields medal in 1994). 
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pure and applied dynamics directly, or bears the visible imprint of its ideas 
and methods. Maybe the book presents a specific chapter on this subject? 

But, of course, the problems came from physics, from engineering. Maybe 
it is both physics and mathematics? Or perhaps it is something different, but 
what can it be? It is not so easy to answer the question, what is the subject 
of our book, even for the authors. But we can say what we want it to be. 
We want it to be a special “meeting point” of pure and applied dynamics, 
of physics, and of engineering sciences. This meeting point has a sufficient 
number of specific problems, methods and results to deserve a special name. 
We propose the name Model Engineering. As long as it is engineering, it is 
synthetic subject: if it is possible to prove something exactly, this is great, 
and we should follow this possibility, but if the physical sense gives us a 
seminal hint, well, we should use it even if the rigorous foundations are far 
from complete. The result is the model that works. In this enormous field 
of intellectual activity our book tends to be in the theoretical corner; we 
focus our study on constructive methods , and the examples that fill up more 
than three-quarters of the book are used for motivation, demonstration and 
development of the methods. 

Which scientific disciplines should meet at the meeting point we build in 
our book? The last century demonstrated the emergence of two disciplines, of 
the theory of dynamical systems in mathematics, and of statistical physics. 
Nonequilibrium statistical physics, in short, is a science about slow-fast mo¬ 
tion decomposition. Dynamic theory is about general features of long-time 
typical behaviour. Our book is about what dynamic theory has to say about 
nonequilibrium systems. The very brief answer is - it makes the theory of 
nonequilibrium systems the theory of slow invariant manifolds. But the re¬ 
verse impact of physics on methods is also significant. Applied mathematics 
and computational physics create a “second (computational) reality”. This is 
a beautiful intellectual building, but in each element of this building, at each 
step of the work, we should take into account the basic physics; the violation 
of a physical law at one place can destroy an important part of the whole 
construction. 

The presented methods to construct slow invariant manifolds certainly 
reflect the authors’ preference and their own work. Much effort was spent to 
coordinate the developed methods with the basic physics at each step. 

The book can be used for various purposes: 

- As a collection of tools for model reduction in kinetics; 

- As a source of mathematical problems; 

- As a guide to physical concepts useful for model reduction; 

- As a collection of successful examples of model reduction; 

As a source of recent literature on model reduction, invariant manifolds 

and related topics. 

We wrote the book for our colleagues and for our students in order to avoid 
in the future the usual excessive explanation: to explain the basic notions and 
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IX 


physical sense, to answer the common questions about invariant manifolds 
and model reduction, about our point of view, about the balance between 
physics, mathematics (dynamics) and engineering in our work. Now we can 
simply hand over this book and suggest reading approaches. There are many 
possible approaches for different purposes. Some of them are presented in the 
introduction. 

As useful background for reading the book, three graduate courses should 
be mentioned: differential equations and dynamical systems, kinetics and 
thermodynamics, and elementary functional analysis. 

Once upon a time Lev Landau gave the following advice: If the Contents 
of a book is interesting to you, close the book and try to write it. If it is 
too difficult a task, then look through the first chapter and try to write it. 
If it is still too hard, go ahead and try to write a section, a subsection, a 
paragraph, a formula. We completely agree with this advice with just one 
addition: please send us your results, because your book will contain another 
point of view, and will be highly interesting. 
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1 Introduction 


1.1 Ideas and References 

In this book, we present a collection of constructive methods to study slow 
(stable) positively invariant manifolds of dynamic systems. The main objects 
of our study are dissipative dynamic systems (finite or infinite) which arise 
in various problems of kinetics. Some of the results and methods presented 
herein may have a more general applicability, and can be useful not only for 
dissipative systems but also, for example, for conservative systems. 

Nonequilibrium statistical physics is a collection of ideas and methods 
for the extraction of slow invariant manifolds. Reduction of description for 
dissipative systems assumes (explicitly or implicitly) the following picture: 
There exists a manifold of slow motions in the phase space of the system. 
From the initial conditions the system goes quickly in a small neighborhood 
of the manifold, and after that moves slowly along this manifold (see, for 
example, [1]). The manifold of slow motion (slow manifold, for short) must 
be positively invariant: if a motion starts on the manifold at to, then it stays 
on the manifold at t > to. The frequently used wording “invariant manifold” 
is not really precise: for dissipative systems, the possibility of extending the 
solutions (in a meaningful way) backwards in time is limited. So, in nonequi- 
librium statistical physics we study positively invariant (or inward invariant) 
slow manifolds. The necessary invariance condition can be written explicitly 
as the differential equation for the manifold immersed into the phase space. 
This picture is directly applicable to dissipative systems. 

Time separation for conservative systems and the way from the reversible 
mechanics (for example, from the Liouville equation) to dissipative systems 
(for example, to the Boltzmann equation) requires some additional ideas and 
steps. For any conservative system, a restriction of its dynamics onto any 
invariant manifold is conservative again. We should represent a dynamics 
of a large conservative system as a result of dynamics in its small subsys¬ 
tems, and it is necessary to take into account that a macroscopically small 
interval of time can be considered as an infinitely large interval for a small 
subsystem, i.e. microscopically. It allows us to represent the relaxation of 
such large systems as an ensemble of indivisible events (for example, colli¬ 
sions). The Bogolyubov-Born-Green-Kirkwood-Yvon (BBGKY) hierarchy 
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STEPS OF REDUCTION 




This diagram must be commutative: 
n i3 = n 23 ° n i2 

Fig. 1.1. The stairs of reduction, step by step 


and Bogolyubov’s method of derivation of the Boltzmann equation give us 
the unexcelled realization of this approach [2]. 

The “stairs of reduction” (Fig. 1.1) lead from the reversible microdynam¬ 
ics to irreversible macrokinetics. The most mysterious is the first step: the 
emergence of irreversibility. We discuss this problem in Chap. 12, but the 
main focus of our attention in the book is the model reduction for dissipative 
systems. 

For dissipative systems, we always keep in mind the following picture 
(Fig. 1.2). The vector field J(x ) generates the motion on the phase space U : 
dx/dt = J(x). An ansatz manifold Q is given, it is the current approximation 
to the invariant manifold. This manifold f2 is described as the image of the 
map F : W —> U. The choice of the space of macroscopic variables W is the 
important step of the model reduction: all corrections of the current ansatz 
manifold are described as images of various F for given W. 

The projected vector field PJ{x) belongs to the tangent space T x , and 
the equation dx/dt = PJ(x ) describes the motion along the ansatz manifold 
Q (if the initial state belongs to Q). The induced dynamics on the space W 
is generated by the vector field 


f = (D v F)~ 1 PJ(F{y)) . 
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Fig. 1.2. The main geometrical structures of model reduction: U is the phase 
space, J(x) is the vector field of the system under consideration: dx/dt = J(x), i? 
is an ansatz manifold, W is the space of macroscopic variables (coordinates on the 
manifold), the map F : W —> U maps any point y G W into the corresponding 
point x — F(y) on the manifold i?, T x is the tangent space to the manifold Q 
at the point x, PJ(x) is the projection of the vector J(x) onto tangent space T x , 
the vector field dy/dt describes the induced dynamics on the space of parameters, 
A = (1 — P)J(x) is the defect of invariance, the affine subspace x + kerP is the 
plain of fast motions, and A £ kerP 


Here the inverse linear operator ( D y F ) 1 is defined on the tangent space 
T F(v), because the map F is assumed to be immersion, that is the differential 
(D y F) is the isomorphism onto the tangent space T F ^ y y 

The main focus of our analysis is the invariance equation 1 : 


A = (1- P)J = 0 t 

the defect of invariance A should vanish. It is a differential equation for an 
unknown map F : W —> U. Solutions of this equation are invariant in the 
sense that the vector field J(x) is tangent to the manifold Q = F(W) for 

1 A.M. Lyapunov studied analytical solutions of similar equations near a fixed 
point [3]. He found these solutions in a form of the Taylor series expansion and 
proved the convergency of those power series near the non-resonant fixed point 
(the Lyapunov auxiliary theorem). In 1960s the invariance equations approach 
was developed, first of all, in the context of the Kolmogorov-Arnold-Moser the¬ 
ory for invariant tori computation [4-6], as a special analytical perturbation 
theory [7,8]. Recently, the main task is to develop constructive non-perturbative 
methods, because the series of perturbations theory diverge and, moreover, the 
high-order terms loose the physical sense for most interesting applications. The 
seminal Kolmogorov’s idea was to use Newton’s method for solution of the invari¬ 
ance equation (instead of the Taylor series expansion) [4]. In this book we discuss 
the methods for invariant manifold construction that exploit the thermodynamic 
properties of the kinetic equations. 
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each point x G Q. But this condition says nothing about the slowness of the 
manifold Q. 

How to choose the projector P? Another form of this question is: how to 
define the plain of fast motions x + ker P? The choice of the projector P is 
ambiguous, from the formal point of view, but the second law of thermody¬ 
namics gives a good hint [9]: the entropy should grow in the fast motion, and 
the point x should be the point of entropy maximum on the plane of fast 
motion x + ker P. That is, the subspace ker P should belong to the kernel of 
the entropy differential: 

kerP^ C ker D X S . 

Of course, this rule is valid for closed systems with entropy, but it can be also 
extended onto open systems: the projection of the “thermodynamic part” of 
J{x) onto T x should have the positive entropy production. If this thermo¬ 
dynamic requirement is valid for any ansatz manifold not tangent to the 
entropy levels and for any thermodynamic vector field, then the thermody¬ 
namic projector is unique [10]. Let us describe this projector P for given point 
x, subspace T x = imP, differential D X S of the entropy S at the point x and 
the second differential of the entropy at the point x, the bilinear functional 
(D^S) X . We need the positively definite bilinear form (z\p) x = — (D%S) x (z,p) 
(the entropic scalar product). There exists a unique vector g such that 
(g\p) x — D x S(p). It is the Riesz representation of the linear functional D X S 
with respect to entropic scalar product. If g ^ 0 then the thermodynamic 
projector is 

where P x is the orthogonal projector onto T x with respect the entropic scalar 
product, and the vector g is splitted onto tangent and orthogonal components: 

g = g 11 + k; g 11 = P ± g ; g ± = (i - P^)g ■ 

This projector is defined if gW ^ 0. 

If g = 0 (the equilibrium point) then P(J) = P ± (J). 

For given T x , the thermodynamic projector (5.25) depends on the point 
x through the ^-dependence of the scalar product (|) x , and also through the 
differential of S in x. 

A dissipative system may have many closed positively invariant sets. For 
example, for every set of initial conditions K, union of all the trajectories 
{x(t),t > 0} with initial conditions x(0) G K is positively invariant. Thus, 
the selection of the slow (stable) positively invariant manifolds becomes an 
important problem 2 . 


2 Nevertheless, there exists a different point of view: “Non-uniqueness, when it 
arises, is irrelevant for modeling” [13], because the differences between the pos¬ 
sible manifolds are of the same order as the differences we set out to ignore in 
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One of the difficulties in the problem of reducing the description is due to 
the fact that there exists no commonly accepted formal definition of a slow 
(and stable) positively invariant manifold. This difficulty is resolved in Chap. 
4 of our book in the following way: First, we consider manifolds immersed 
into a phase space and study their motion along trajectories. Second, we sub¬ 
tract from this motion the motion of immersed manifolds along themselves, 
and obtain a new equation for dynamics of manifolds in the phase space: 
the manifold Q moves by the vector field A. It is the film extension of the 
dynamics'. 

d F t (y) _ 
d t 

where the defect of invariance, A = (1 — P) J, depends on the point x = F(y) 
and on the tangent space to the manifold Q = F(W ) at this point. Invariant 
manifolds are fixed points for this extended dynamics, and slow invariant 
manifolds are Lyapunov stable fixed points. 

The main body of this book is about how to actually compute the slow 
invariant manifold. We present three approaches to constructing slow (stable) 
positively invariant manifolds. 

- Iteration method for solution of the invariance equation (Newton method 
subject to incomplete linearization); 

Relaxation methods based on the film extension of the original dynamic 
system; 

The method of natural projector that projects not the vector fields, but 
rather finite segments of trajectories. 

The Newton method (with incomplete linearization) is the iteration 
method for solving the invariance equation. On each iteration we linearize 
the invariance equation and solve obtained linear equation. In the defect of 
invariance A = (1 — P)J(x) both the vector field J{pc) = J(F(y)) (y G W) 
and the projector P depend on the unknown map F (P depends on the point 
x G W and on the tangent space T x = im D y F). On each iteration we use for 
J(F(y)) the first-order (linear in P) approximation, and for P only the zero- 
order (constant) one. The iteration method with this incomplete linearization 
leads to the slowest invariant manifold [11]. The Newton method (with in¬ 
complete linearization) is convenient for obtaining the explicit formulas - 
even one iteration can give a good approximation. 

Relaxation methods are directed more towards the numerical implemen¬ 
tation. Nevertheless, several first steps also can give appropriate analytical 
approximations, competitive with other methods. These methods are based 
on the stepwise solution of the differential equation dF(y)/dt = A (the film 
extension of the dynamics). 

establishing the low-dimensional model. We do not share this viewpoint because 
it may be relevant only if there exists a small parameter, and, moreover, only 
asymptotically when this small parameter tends to zero. 
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Finally, the natural projector method constructs not the manifold itself 
but a projection of slow dynamics onto some set of variables. This method is 
the successor of two important methods: the Ehrenfests’ coarse-graining [15] 
and the Hilbert method for solution of the Boltzmann equation [16]. It can 
by applied to reversible and irreversible systems, and allows us to make the 
first step of reduction (see Fig. 1.1) as well as the following steps. 

The Newton method subject to incomplete linearization was developed 
for the construction of slow (stable) positively invariant manifolds in the 
following problems: 

- Derivation of the post-Navier-Stokes hydrodynamics from the Boltzmann 
equation [11,12,14,17]. 

- Description of the dynamics of polymers solutions [12,106]. 

- Correction of the moment equations [12,21]. 

- Reduced description for chemical kinetics [12,22,23,105]. 

Relaxation methods based on the film extension of the original dynamic 
system were applied to the Fokker-Planck equation [12,24]. Applications of 
these methods in the theory of the Boltzmann equation can benefit from the 
estimations, obtained in the papers [26,27]. 

The method of natural projector was originally applied to derivation of the 
dissipative equations of macroscopic dynamics from the conservative equa¬ 
tions of the microscopic dynamics [12,29-35]. Using this method, new equa¬ 
tions were obtained for the post-Navier-Stokes hydrodynamics, equations of 
plasma hydrodynamics and others [30,34]. This short-memory approxima¬ 
tion was applied to the Wigner formulation of quantum mechanics [36-38]. 
The dissipative dynamics of a single quantum particle in a confining external 
potential is shown to take the form of a damped oscillator whose effective 
frequency and damping coefficients depend on the shape of the quantum- 
mechanical potential [35]. Further examples of the coarse-graining quantum 
fields dynamics can be found in [39]. The natural projector method can also 
be applied effectively to dissipative systems: instead of the Chapman-Enskog 
method in theory of the Boltzmann equation, for example. 

The most natural initial approximation for the methods under considera¬ 
tion is a quasiequilibrium manifold. It is the manifold of conditional maxima 
of the entropy. The majority of works on nonequilibrium thermodynamics 
deal with corrections to quasi-equilibrium approximations, or with applica¬ 
tions of these approximations (with or without corrections). The construction 
of the quasi-equilibrium allows for the following generalization: almost every 
manifold can be represented as a set of minimizers of the entropy under lin¬ 
ear constraints. However, in contrast to the standard quasiequilibrium, these 
linear constraints will depend on the point on the manifold. We describe the 
quasiequilibrium manifold and the quasiequilibrium projector on the tan¬ 
gent space of this manifold. This projector is orthogonal with respect to the 
entropic scalar product (the bilinear form defined by the negative second dif¬ 
ferential of the entropy). We construct the thermodynamical projector, which 
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transforms the arbitrary vector field equipped with the given Lyapunov func¬ 
tion (the entropy) into a vector field with the same Lyapunov function for an 
arbitrary anzatz manifold which is not tangent to the level of the Lyapunov 
function. The uniqueness of this construction is demonstrated. 

Here, a comment on the status of most of the statements in this book 
is in order. Just like the absolute majority of claims concerning such things 
as general solutions of the Navier-Stokes or the Boltzmann equation, they 
have the status of being plausible. They can become theorems only if one 
restricts essentially the set of the objects under consideration. Among such 
restrictions we should mention cases of the exact reduction, for example, exact 
derivation of hydrodynamics from kinetics [40,42]. In these (still infinite¬ 
dimensional) examples one can compare different methods, for example, the 
Newton method with the methods of series summation in the perturbation 
theory [42,43]. 

Also, it is necessary to stress here, that even if in the limit all the methods 
lead to the same results, they can give rather different approximations “on 
the way”. 

The rigorous foundation of the constructive methods of invariant mani¬ 
folds should, in particular, include theorems about persistence of invariant 
manifolds under perturbations. For instance, the compact normally hyperbolic 
invariant manifolds persist under small perturbations for finite-dimensional 
dynamical systems [46,47]. The most well-known result of this type is the 
Kolmogorov-Arnold-Moser theory about persistence of almost all invariant 
tori of completely integrable system under small perturbations [4-6]. 

Such theorems exist for some classes of infinite dimensional dissipative 
systems too [48]. Unfortunately, it is not proven until now that many impor¬ 
tant systems (the Boltzmann equation, the three-dimensional Navier-Stokes 
equations, the Grad equations, etc.) belong to these classes. So, it is necessary 
to act with these systems without a rigorous basis. 

The new quantum field theory formulation of the problem of persistence of 
invariant tori in perturbed completely integrable systems was obtained [68], 
and a new proof of the KAM theorem for analytic Hamiltonians based on 
the renormalization group method was given. 

Two approaches to the construction of the invariant manifolds are widely 
used: the Taylor series expansion for the solution of the invariance equa¬ 
tion [3,50-52] and the method of renormalization group [53,54,56-59]. The 
advantages and disadvantages of the Taylor series expansion are well-known: 
constructivity versus the absence of physical meaning for the high-order terms 
(often), and divergence in the most interesting cases (often). 

In the paper [56], a geometrical formulation of the renormalization group 
method for global analysis was given. It was shown that the renormalization 
group equation can be interpreted as an envelope equation. Recently [57] the 
renormalization group method was formulated in terms of invariant mani¬ 
folds. This method was applied to derive kinetic and transport equations from 
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the respective microscopic equations [58]. The derived equations include the 
Boltzmann equation in classical mechanics (see also the paper [55], where it 
was shown for the first time that kinetic equations such as the Boltzmann 
equation can be understood naturally as renormalization group equations), 
the Fokker-Planck equation, a rate equation in a quantum field theoretical 
model. 

From the point of view of the authors of the paper [55], the relation of 
renormalization group theory and reductive perturbation theory has simul¬ 
taneously been recognized: renormalization group equations are actually the 
slow-motion equations which are usually obtained by reductive perturbation 
methods. 

The renormalization group approach was applied to the stochastic Navier- 
Stokes equation in order to model fully developed fluid turbulence [60-62]. 
For the evaluation of the relevant degrees of freedom the renormalization 
group technique was revised for discrete systems in the recent paper [59]. 

The kinetic theory approach to subgrid modeling of fluid turbulence be¬ 
came more popular recently. [63-66]. A mean-field approach (filtering out 
subgrid scales) was applied to the Boltzmann equation in order to derive a 
subgrid turbulence model based on kinetic theory. It was demonstrated [66] 
that the only Smagorinsky type model which survives in the hydrodynamic 
limit on the viscosity time scale is the so-called tensor-diffusivity model [67]. 

The first systematic and successful method of constructing invariant man¬ 
ifolds for dissipative systems was the celebrated Chapman-Enskog method [70] 
for the Boltzmann kinetic equation. The Chapman-Enskog method results 
in a series development of the so-called normal solution (the notion intro¬ 
duced by Hilbert [16]) where the one-body distribution function depends on 
time and space only through its locally conserved moments. To the first ap¬ 
proximation, the Chapman-Enskog method leads to hydrodynamic equations 
with transport coefficients expressed in terms of molecular scattering cross- 
sections. However, the higher order terms of the Chapman-Enskog expansion 
bring in the “ultra-violet catastrophe” (noticed first by Bobylev [72]) and 
negative viscosity. This drawback pertinent to the Taylor series expansion 
disappears as soon as the Newton method is used to construct the invariant 
manifold [11]. 

The Chapman-Enskog method was generalized many times [76] and gave 
rise to a host of subsequent works and methods, such as the famous method 
of the quasi-steady state in chemical kinetics, pioneered by Bodenstein and 
Semenov and explored in considerable detail by many authors (see, for ex¬ 
ample, [22,77-81]), and the theory of singularly perturbed differential equa¬ 
tions [77,82-87]. 

There exists a set of methods to construct an ansatz for the invariant 
manifold based on the spectral decomposition of the Jacobian. The idea to 
use the spectral decomposition of Jacobian fields in the problem of separating 
the motions into fast and slow originates from analysis of stiff systems [88], 
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and from methods of sensitivity analysis in control theory [89,90]. One of 
the currently most popular methods based on the spectral decomposition of 
Jacobian fields is the construction of the so-called intrinsic low-dimensional 
manifold (ILDM) [93]. 

These methods were thoroughly analyzed in two papers [94,95]. It was 
shown that the successive applications of the Computational Singular Per¬ 
turbation (CSP) algorithm (developed in [90]) generate, order by order, the 
asymptotic expansion of a slow manifold, and the manifold identified by the 
ILDM technique (developed in [93]) agrees with the invariant manifold to 
some order. An explicit algorithm based on the CSP method is designed for 
the integration of stiff systems of PDEs by means of explicit schemes [91]. 
The CSP analysis of time scales and manifolds in a transient flame-vortex 
interaction was presented in [92]. 

The theory of inertial manifold is based on the special linear dominance in 
higher dimensions. Let an infinite-dimensional system have a form: u + Au = 
R(u), where A is self-adjoint, and has a discrete spectrum A^ —» oc with 
sufficiently big gaps between A^, and let R(u) be continuous. One can build 
the slow manifold as the graph over a root space of A [96]. The textbook [100] 
provides an exhaustive introduction to the main ideas and methods of this 
theory. Systems with linear dominance have limited utility in kinetics. Often 
there are no big spectral gaps between Aand even the sequence A^ —> oo 
might be bounded (for example, this is the case for the model Bhatnagar- 
Gross-Krook (BGK) equations, or for the Grad equations). Nevertheless, the 
concept of the inertial attracting manifold has wider field of applications than 
the theory, based on the linear dominance assumption. 

The Newton method with incomplete linearization and the relaxation 
method allow us to find an approximate slow invariant manifolds without 
Jacobian field spectral decomposition. Moreover, a necessary slow invariant 
subspace of the Jacobian at the equilibrium point appears as a by-product 
of the Newton iterations (with incomplete linearization), or of the relaxation 
method. 

It is of importance to search for minimal (or subminimal) sets of natural 
parameters that uniquely determine the long-time behaviour of a system. This 
problem was first discussed by Foias and Prodi [97] and by Ladyzhenskaya [98] 
for the two-dimensional Navier-Stokes equations. They have proved that the 
long-time behaviour of solutions is completely determined by the dynamics 
of sufficiently large number of Fourier modes. A general approach to the 
problem on the existence of a finite number of determining parameters has 
been discussed [99,100]. 

The past decade has witnessed a rapid development of the so-called set 
oriented numerical methods [101]. The purpose of these methods is to com¬ 
pute attractors, invariant manifolds (often, computation of stable and un¬ 
stable manifolds in hyperbolic systems [102-104]). Also, one of the central 
tasks of these methods is to gain statistical information, i. e. computations 
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of physically observable invariant measures. The distinguished feature of the 
modern set-oriented methods of numerical dynamics is the use of ensembles 
of trajectories within a relatively short propagation time instead of a long 
time single trajectory. 

In this book we systematically consider a discrete analog of the slow (sta¬ 
ble) positively invariant manifolds for dissipative systems, invariant grids. 
These invariant grids were introduced in [22]. Here we shall describe the New¬ 
ton method subject to incomplete linearization and the relaxation methods 
for the invariant grids [105]. 

It is worth mentioning that the problem of the grid correction is fully 
decomposed into the tasks of the grid’s nodes correction. The edges between 
the nodes appear only in the calculation of the tangent spaces at the nodes. 
This fact determines the high computational efficiency of the invariant grids 
method. 

Let the (approximate) slow invariant manifold for a dissipative system be 
found. Why have we constructed it? One important part of the answer to this 
question is: We have constructed it to create models of open system dynamics 
in the neighborhood of this manifold. Different approaches for this modeling 
are described. 

We apply these methods to the problem of reduced description in poly¬ 
mer dynamics and derive the universal limit in dynamics of dilute polymeric 
solutions. It is represented by the revised Oldroyd 8 constants constitutive 
equation [106] for the polymeric stress tensor. Coefficients of this constitu¬ 
tive equation are expressed in terms of the microscopic parameters. This 
limit of dynamics of dilute polymeric solutions is universal, and any phys¬ 
ically consistent equation should contain the obtained equation as a limit, 
or one should explain why it is not achieved. Such universal limit equations 
are well-known in various fields of physics. For example, the Navier-Stokes 
equation in fluid dynamics is an universal limit for dynamics of simple gas 
described by the Boltzmann equation, the Korteweg-De-Vries equation is 
universal in the description of the dispersive dissipative nonlinear waves, etc. 

The phenomenon of invariant manifold explosion in driven open systems 
is demonstrated on the example of dumbbell models of dilute polymeric so¬ 
lutions [109]. This explosion gives us a possible mechanism of drag reduction 
in dilute polymeric solutions [110]. 

Suppose that for the kinetic system the approximate invariant manifold 
has been constructed and the slow motion equations have been derived. Sup¬ 
pose that we have solved the slow motion system and obtained x s i(t). We 
consider the following two questions: 

How well does this solution approximate the true solution x(t) given the 

same initial conditions? 

- How is it possible to use the solution x s i(t) for its refinement without 

solving the slow motion system (or its modifications) again? 
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These two questions are interconnected. The first question states the prob¬ 
lem of the accuracy estimation. The second one states the problem of post¬ 
processing [348-351]. We propose various algorithms for post-processing and 
accuracy estimation, and give an example of application. 

Our collection of methods and algorithms can be incorporated into re¬ 
cently developed technologies of computer-aided multiscale analysis which 
enable “level jumping” between microscopic and macroscopic (system) lev¬ 
els. It is possible both for the traditional technique based on transition from 
microscopic equations to macroscopic equations and for the “equation-free” 
approach [107]. This approach developed in recent work [108], when success¬ 
ful, can bypass the derivation of the macroscopic evolution equations when 
these equations conceptually exist but are not available in closed form. The 
mathematics-assisted development of a computational superstructure may 
enable alternative descriptions of the problem physics (e.g. Lattice Boltzmann 
(LB), kinetic Monte- Carlo (KMC) or Molecular Dynamics (MD) microscopic 
simulators, executed over relatively short time and space scales) to perform 
systems level tasks (integration over relatively large time and space scales, 
coarse bifurcation analysis, optimization, and control) directly. It is possible 
to use macroscopic invariant manifolds in this environment without explicit 
equations. 


1.2 Content and Reading Approaches 

The present book comprises sections of two kinds. The first includes the sec¬ 
tions that contain basic notions, methods and algorithms. Another group of 
sections entitled “Examples” contain various case studies where the meth¬ 
ods are applied to specific equations. Exposition in the “Examples” sections 
is not as consequent as in the basic sections. Most of the examples can be 
read more or less independently. Logical connections between chapters are 
presented in Fig. 1.3. 

The main results and notions presented in the book are as follows. In this 
Chap. 1 we present the main ideas, references, abstracts of chapters, and the 
possible reading plans. 

Chapter 2 is the second introduction, it introduces the main equations 
of kinetics: the Boltzmann equation, equations of chemical kinetics, and the 
Fokker-Planck equation. The main methods of reduction for these equations 
are also discussed: from the Chapman-Enskog and Hilbert methods to qua¬ 
siequilibrium and quasi-steady state approximations. 

In Chap. 3 we write down the invariance equation in the differential form. 
This equation gives the necessary conditions of invariance of a manifold im¬ 
mersed into the phase space of a dynamical system. In order to estimate 
the discrepancy of an ansatz manifold, the defect of invariance if defined. 
The introduction of this defect of invariance requires a projector field. These 
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Fig. 1.3. Logical connections between chapters. All the chapters depend on 
Chap. 3. For understanding examples and problems it may be useful (but not 
always necessary) to read Chap. 2 


notions, defect of invariance and projector field, as well as the invariance 
equation play the central role in the whole book. 

Chapter 4 is devoted to the definition of slowness of a positively invariant 
manifold. The equation of motion of the manifold (the “film”) immersed into 
the phase space of the dynamical system is discussed (equation for the film 
motion). A slow positively invariant manifold is defined as a stable fixed point 
for this motion. The projector field introduced in Chap. 3 is crucial for the 
definition of the stability. 

The main thermodynamic structures, the entropy, the entropic scalar 
product, quasiequilibrium, and the thermodynamic projector, are introduced 
in Chap. 5. The quasiequilibrium manifold is the manifold of conditional en¬ 
tropy maxima for given values of macroscopic variables. These values para¬ 
metrize this manifold. Most of the works on nonequilibrium thermodynamics 
deal with corrections to quasiequilibrium approximations, or with applica¬ 
tions of these approximations (with or without corrections). This viewpoint 
is not the only possible, but it proves very efficient for the construction of a 
variety of useful models, approximations and equations, as well as methods 
to solve them. 

The entropic scalar product is generated by the second differential of the 
entropy. It endows the space of states by the unique distinguished Riemannian 
structure. The thermodynamic projector is the operator which transforms 
the arbitrary vector field equipped with the given Lyapunov function into a 
vector field with the same Lyapunov function. Uniqueness of such projector 
is proved. 
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In Chap. 5 we start the series of examples for the Boltzmann equations. 
First, we analyze the defect of invariance for the Local Maxwellian manifold: 
the manifold of the locally equilibrium distributions. Second, we present the 
quasi-equilibrium closure hierarchies for the Boltzmann equation. In 1949, 
Harold Grad [201] extended the basic assumption behind the Hilbert and 
Chapman-Enskog methods (the space and time dependence of the normal 
solutions is mediated by the five hydrodynamic moments). A physical ratio¬ 
nale behind the Grad moment method is an assumption of the decomposition 
of motion, (i) During the time of order r, a set of distinguished moments M' 
(which include the hydrodynamic moments and a subset of higher-order mo¬ 
ment) does not change significantly as compared to the rest of the moments 
M" (the fast evolution), (ii) Towards the end of the fast evolution, the values 
of the moments M" become unambiguously determined by the values of the 
distinguished moments M'. (iii) On the time of order 6 r, dynamics of 
the distribution function is determined by the dynamics of the distinguished 
moments while the rest of the moments remains to be determined by the 
distinguished moments (the slow evolution period). 

An important generalization of the Grad moment method is the con¬ 
cept of quasiequilibrium approximations. The quasiequilibrium distribution 
function for a set of distinguished moments M' maximizes the entropy den¬ 
sity S for fixed M '. The quasiequilibrium manifold is the collection of the 
quasiequilibrium distribution functions for all admissible values of M. The 
quasiequilibrium approximation is the simplest and very useful (not only in 
the kinetic theory itself) implementation of the hypothesis about time sepa¬ 
ration. 

The quasiequilibrium approximation does not exist if the highest order 
moment is an odd polynomial of velocity (therefore, there exists no quasi- 
equilibrium for thirteen Grad’s moments). The Grad moment approxima¬ 
tion is the first-order expansion of the quasiequilibrium around the local 
Maxwellian. An explicit method of constructing of approximations (the Tri¬ 
angle Entropy Method) is developed for strongly nonequilibrium problems 
of Boltzmann-type kinetics, i.e. when standard moment variables are insuffi¬ 
cient. This method enables one to treat any complicated nonlinear functionals 
that fit the physics of a problem (such as, for example, rates of processes) as 
new independent variables. 

The method is applied to the problem of derivation of hydrodynamics 
from the Boltzmann equation. New macroscopic variables are introduced 
(moments of the Boltzmann collision integral, or collision moments). They 
are treated as independent variables rather than as infinite moment series. 
This approach gives the complete account of the rates of scattering processes. 
Transport equations for scattering rates are obtained (the second hydrody¬ 
namic chain), similar to the usual moment chain (the first hydrodynamic 
chain). Using the triangle entropy method, three different types of macro¬ 
scopic description are considered. The first type involves only moments of 
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distribution functions, and the results coincide with those of the Grad method 
in the Maximum Entropy version. The second type of description involves 
only collision moments. Finally, the third type involves both the moments 
and the collision moments (the mixed description). The second and the mixed 
hydrodynamics are sensitive to the choice of the collision model. The second 
hydrodynamics is equivalent to the first hydrodynamics only for Maxwell 
molecules, and the mixed hydrodynamics exists for all types of collision mod¬ 
els excluding Maxwell molecules. Various examples of the closure of the first, 
of the second, and of the mixed hydrodynamic chains are considered for the 
hard spheres model. It is shown, in particular, that the complete account of 
scattering processes leads to a renormalization of transport coefficients. 

We apply the developed method to a classical problem: determination of 
molecular dimensions (as diameters of equivalent hard spheres) from experi¬ 
mental viscosity data. It is the third example in Chap. 5. 

The first non-perturbative method for solution of the invariance equation 
is developed in Chap. 6. It is the Newton method with incomplete lineariza¬ 
tion. The incomplete linearization means that in the Newton-type iteration 
for the invariance equation we do not use the whole differential of the right- 
hand side of the invariance equation: the differential of the projector field 
is excluded. This modification of the Newton method leads to selection of 
the slowest invariant manifold. The series of examples for the Boltzmann 
equations is continued in this chapter. The non-perturbative correction to 
the Local Maxwellian manifold is constructed, and the equations of the high- 
order (the post-Navier-Stokes) hydrodynamics are obtained. 

In Chap. 5 we use the second law of thermodynamics - existence of the 
entropy - in order to equip the problem of constructing slow invariant man¬ 
ifolds with a geometric structure. The requirement of the entropy growth 
(universally, for all the reduced models) significantly restricts the form of the 
thermodynamic projectors. In Chap. 7 we introduce a different but equally 
important argument - the micro-reversibility ( T- invariance), and its macro¬ 
scopic consequences, the Onsager reciprocity relations. The main idea in this 
chapter is to use the reciprocity relations for the fast motions. In order to ap¬ 
preciate this idea, we should mention that the decomposition of motions into 
fast and slow is not unique. Requirement of the Onsager reciprocity relations 
for any equilibrium point of fast motions implies the selection (filtration) of 
the fast motions. We term this the Onsager filter. Equilibrium points of fast 
motions are all the points on manifolds of slow motions. The formalism of 
the quasi-chemical representation is one of the most developed means of mod¬ 
elling, it makes it possible to “assemble” complex processes out of elementary 
processes. This formalism is very natural for representation of the reciprocity 
relations. And again, the Example to this chapter continues the “Boltzmann 
series”. It is the quasi-chemical representation and the self-adjoint (i.e. On¬ 
sager) linearization of the Boltzmann collision operator in the slow, but not 
obligatory equilibrium states. 
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In Chap. 8 a new class of exactly solvable problems in nonequilibrium 
statistical physics is described. The systems that allow the exact solution of 
the reduction problem are presented. Up to now, the problem of the exact 
relationship between kinetics and hydrodynamics remains unsolved. All the 
methods used to establish this relationship are not rigorous, and involve ap¬ 
proximations. In this chapter, we consider situations where hydrodynamics is 
the exact consequence of kinetics, and in that respect, a new class of exactly 
solvable models of statistical physics has been established. The Chapman- 
Enskog method is treated as the Taylor series expansion approach to solving 
the appropriate invariance equation. A detailed treatment of the classical 
Chapman-Enskog derivation of hydrodynamics is given in the framework of 
Grad’s moment equations. Grad’s systems are considered as the minimal ki¬ 
netic models where the Chapman-Enskog method can be studied exactly, 
thereby providing the basis to compare various approximations in extend¬ 
ing the hydrodynamic description beyond the Navier-Stokes approximation. 
Various techniques, such as the method of partial summation, the Pade ap- 
proximants, and the invariance principle are compared both in linear and 
nonlinear situations. 

In Chap. 9 the “large stepping” relaxation method for solution of the 
invariance equation is developed. The relaxation method is an alternative to 
the Newton iteration method described in Chap. 6: The initial approximation 
to the invariant manifold is moved with the film extension of the dynamics 
described in Chap. 4. The proposed step in time for the stepwise solution 
of the film extension equation is the maximal possible step that does not 
violate the thermodynamic conditions. In the examples, the idea of the large 
stepping is applied to the Fokker-Planck equation and to the initial layer 
problem for the Boltzmann equation. The obtained approximate solutions of 
the initial layer problem are compared to the exact solutions. 

How can we represent invariant manifolds numerically? How can we use 
the numerical representation in all the methods for invariant manifold re¬ 
finement? Chapter 10 is devoted to answering these questions. A grid-based 
version of the method of invariant manifold is developed. The most essential 
element of this chapter is the systematic consideration of a discrete analogue 
of the slow (stable) positively invariant manifolds for dissipative systems, in¬ 
variant grids. The invariant grid is defined as a mapping of finite-dimensional 
grids into the phase space of a dynamic system. We define the differential op¬ 
erators on the grid as difference operators, hence, it is possible to define 
the tangent space at each point of the grid mapped into the phase space. If 
the tangent space is constructed, then the invariance equation can be writ¬ 
ten down. We describe the Newton method and the relaxation method for 
solution of this discrete analogue of the invariance equation. Examples for 
this chapter are taken from the chemical kinetics. One attractive feature of 
two-dimensional invariant grids is the possibility to use them as a screen, on 
which one can display different functions and dynamic of the system. 
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P. and T. Ehrenfest suggested in 1911 a model of dynamics with a coarse- 
graining of the original conservative system in order to introduce irreversibil¬ 
ity [15]. The Ehrenfests considered a partition of the phase space into small 
cells, and they have suggested combining the motions of the phase space en¬ 
semble due to the Liouville equation with coarse-graining “shaking” steps - 
averaging of the density of the ensemble over the phase cells. This general¬ 
izes to the following: combination of the motion of the phase ensemble due 
to microscopic equations with returns to the quasiequilibrium manifold while 
preserving the values of the macroscopic variables. In Chap. 11 we develop the 
method of natural projector, a formalism of nonequilibrium thermodynamics 
based on this generalization. 

The method of natural projector can be considered as a development of 
the ideas of the Hilbert method from the theory of the Boltzmann equation. 
The main new element in the method of natural projector with respect to the 
Hilbert method is the construction of the macroscopic equations from the 
microscopic equations, not just a “normal solution” to a microscopic equation. 
The obtained macroscopic equations contain one unknown parameter, the 
time between coarse-graining (shaking) steps (r). This parameter can be 
obtained from the experimental data, or from independent microscopic or 
phenomenological consideration. 

In the first example to this chapter the microscopic dynamics is given 
by the one-particle Liouville equation. The set of macroscopic variables is 
density, momentum density, and the density of average kinetic energy. The 
correspondent quasiequilibrium distribution is the local Maxwell distribu¬ 
tion. For the hydrodynamic equations, the zeroth (quasiequilibrium) approx¬ 
imation is given by the Euler equations of compressible nonviscous fluid. 
The next order approximation gives the Navier-Stokes equations which have 
dissipative terms. Higher-order approximations to the hydrodynamic equa¬ 
tions, when they are derived from the Boltzmann kinetic equation by the 
Chapman-Enskog expansion (so-called Burnett approximation), are prone 
to various difficulties, in particular, they exhibit instability of sound waves at 
sufficiently short wave length (see Chap. 8). Here we demonstrate how model 
hydrodynamic equations, including the post-Navier-Stokes approximations, 
can be derived on the basis of the coarse-graining idea, and find that the 
resulting equations are stable, contrary to the Burnett equation. 

In the second example the fluctuation-dissipation formula is derived by 
the method of natural projector and is illustrated by the explicit computation 
for the exactly solvable McKean kinetic model [285]. It is demonstrated that 
the result is identical, on the one hand, to the sum of the Chapman-Enskog 
expansion, and, on the other hand, to the exact solution of the invariance 
equation. 

In Chap. 12 the general geometrical framework of nonequilibrium ther¬ 
modynamics is developed. It is the generalization of the method of natural 
projector (Chap. 11) to large steps in time. The notion of macros comically 
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definable ensembles is introduced. The thesis about macroscopically defin¬ 
able ensembles is suggested. This thesis should play the same role in the 
nonequilibrium thermodynamics, as the Church-Turing thesis in the theory 
of computability. The primitive macroscopically definable ensembles are de¬ 
scribed. These are ensembles with macroscopically prepared initial states. 

The method for computing trajectories of primitive macroscopically de¬ 
finable nonequilibrium ensembles is elaborated. These trajectories are repre¬ 
sented as sequences of deformed equilibrium ensembles and simple quadratic 
models between them. The primitive macroscopically definable ensembles 
form a manifold in the space of ensembles. We call this manifold the film of 
nonequilibrium states. The equation for the film and the equation for the en¬ 
semble motion on the film are written down. The notion of the invariant film 
of non-equilibrium states, and the method of its approximate construction 
transform the problem of nonequilibrium kinetics into a series of problems of 
equilibrium statistical physics. The developed methods allow us to solve the 
problem of macro-kinetics even when there are no autonomous equations of 
macro-kinetics. 

The slow invariant manifold for a closed system has been found. What 
next? Chapter 13 gives the answer to this question. The theory of invari¬ 
ant manifolds is developed for weakly open systems. In the first example the 
method of invariant manifold for driven systems is developed for a derivation 
of a reduced description in kinetic equations of dilute polymeric solutions. 
The method applies to any models of polymers and is consistent with basic 
physical requirements: frame invariance and dissipativity of resulting consti¬ 
tutive equation. It is demonstrated that this reduced description becomes 
universal in the limit of small Deborah and Weissenberg numbers, and it is 
represented by the revised Oldroyd 8 constants constitutive equation for the 
polymeric stress tensor. This equation differs from the classical Oldroyd 8 
constants constitutive equation by one additional term. Coefficients of this 
constitutive equation are expressed in terms of the microscopic parameters 
of the polymer model. A systematic procedure of corrections to the revised 
Oldroyd 8 constants equations is developed. Results are tested with simple 
flows. 

In the second example in this chapter the derivation of macroscopic equa¬ 
tions from the simplest dumbbell models is revisited. It is demonstrated that 
the onset of the macroscopic description is sensitive to the flows. For the 
FENE-P model it is shown that there is a possibility of “explosion” of the 
Gaussian manifold: with a small initial deviation, solution of the kinetic equa¬ 
tion very quickly deviate from the manifold, and then slowly come back to 
the stationary point located on the Gaussian manifold. Nevertheless, the 
Gaussian manifold remains invariant. Some consequences of these observa¬ 
tions are discussed. A new class of closures is introduced, the kinetic mul¬ 
tipeak polyhedra. Distributions of this type are expected in kinetic models 
with multidimensional instability as universally, as the Gaussian distribution 
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appears for stable systems. The number of possible relatively stable states of 
a nonequilibrium system grows as 2 m , and the number of macroscopic para¬ 
meters is of the order mn, where n is the dimension of configuration space, 
and m is the number of independent unstable directions in this space. The 
elaborated class of closures and equations pretends to describe the effects of 
so-called “molecular individualism”. 

How can we prove that all the attractors of a infinite-dimensional system 
belong to a finite-dimensional manifold? How can we estimate the dimension 
of this manifold? There are two methods for such estimations, discussed in 
Chap. 14. First, if we find that k-dimensional volumes are contracted due 
to dynamics, then (after some additional technical steps concerning exis¬ 
tence of the positively-invariant bounded set and uniformity of the k- volume 
contraction on this set) we can state that the Hausdorff dimension of the 
maximal attractor is less, then k. Second, if we find the representation of 
our system as a nonlinear kinetic system with conservation of supports of 
distributions, then (again, after some additional technical steps) we can state 
that the asymptotics is finite-dimensional. This conservation of support has 
a quasi-biological interpretation, the inheritance (if a gene is not presented 
in an isolated population without mutations, then it cannot appear in time). 
The finite-dimensional asymptotics demonstrates the effects of “natural” se¬ 
lection. 

The post-processing (Chap. 15) is a very simple, but attractive idea. In 
the method of invariant manifold we improve the whole manifold on each 
iteration. If we need only one or several solutions, this whole manifold may 
be too big for our goals, and we can restrict our activity by refinement of a 
given solution: a curve instead of a multi-dimensional manifold. The classical 
Picard iteration for a solution of a differential equation gives the simplest 
post-processing. Various forms of post-processing are presented. In the ex¬ 
ample to this chapter the method which recognizes the onset and breakdown 
of the macroscopic description in microscopic simulations is presented. The 
method is based on the invariance of the macroscopic dynamics relative to the 
microscopic dynamics, and it is demonstrated for a model of dilute polymeric 
solutions where it decides switching between Direct Brownian Dynamics sim¬ 
ulations and integration of constitutive equations. 

The list of cited literature is by no means complete although we spent 
effort in order to reflect at least the main directions of studies related to 
computations of the invariant manifolds. We think that this list is more or 
less exhaustive in the second-order approximation. 

There are many different roads of reading this book. Chapter 3 is nec¬ 
essary for reading all of the other chapters, as is shown in the flowchart 
(Fig. 1.3). Here we propose several possible roads. This is not the exhaustive 
list, and everybody can invent his own road. 

The short formal road : Chap. 3, Sects.: 4.1, 5.1-5.3, 6.1, 7.1, 9.1, 10.1, 11.1, 
13.1-13.4, 15.1. If you are ready to look at the formal ordinary differential 
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equation -^| = J(x), x G C7, and to imagine in this form all the kinetic 
equations, from the Boltzmann equation to the Fokker-Planck equation, then 
this formal road is the best way to start. After that, you can choose various 
examples and chapters. Before reading the examples sections, it may be useful 
to look through Chap. 2. 

The long formal road : Chaps. 3, 4, Sects.: 5.1-5.3, 6.1, 7.1, 9.1, 10.1, 11.1, 

13.1- 13.4, 14.1, 14.2, 15.1. 

The short Boltzmann road : Chap. 2 (including chemical kinetics), Chap. 3, 
Sects. 5.1-5.3, 5.5, 6.1-6.3, Chap. 8. This road gives the invariance equation, 
the Newton method with incomplete linearization for solution of this equa¬ 
tion, the theory of Local Maxwellian manifold, and the application of this 
method to correction of these manifolds. Chapter 8 adds the exact solutions 
of the reduction problem and the test of the developed methods on these 
solutions. 

The long Boltzmann road: Chap. 2 (including chemical kinetics), Chap. 3, 
Sects. 5.1-5.3, 5.5, 5.6, 5.7, Chaps. 6-8, Sects. 4.1, 9.1, 9.3. Exhaustive read¬ 
ing: everything concerning the Boltzmann equation. 

The nonequilibrium thermodynamic road: Chap. 2, Chap. 3, Sects. 4.1, 

5.1- 5.4, 7.1, 9.1, Chaps. 11, 12, 14. This road can be naturally supplemented 
by some sections from the Boltzmann roads. 

The short Grad road: Chaps. 2, 3, Sects. 5.1-5.6, 6.1, Chap. 8. 
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2.1 The Boltzmann Equation 

2.1.1 The Equation 

The Boltzmann equation is the first and the most celebrated nonlinear ki¬ 
netic equation introduced by the great Austrian scientist Ludwig Boltzmann 
in 1872 [111]. This equation describes the dynamics of a moderately rarefied 
gas, taking into account two processes: the free flight of the particles, and 
their collisions. In its original version, the Boltzmann equation has been for¬ 
mulated for particles represented by hard spheres. The physical condition of 
rarefaction means that only pair collisions are taken into account, a math¬ 
ematical specification of which is given by the Grad-Boltzmann limit [200]: 
If N is the number of particles, and a is the diameter of the hard sphere, 
then the Boltzmann equation is expected to hold when N tends to infinity, 
a tends to zero, Na 3 (the volume occupied by the particles) tends to zero, 
while Na 2 (the total collision cross section) remains constant. The micro¬ 
scopic state of the gas at time t is described by the one-body distribution 
function P(x,v,t), where x is the position of the center of the particle, and 
v is the velocity of the particle. The distribution function is the probability 
density of finding the particle at time t within the infinitesimal phase space 
volume centered at the phase point (x,v). The collision mechanism of two 
hard spheres is presented by a relation between the velocities of the particles 
before [v and w] and after [v' and w'] their impact: 

v' = v — n(n, v — w) , 

w' = w + n(n, v — w) , 

where n is the unit vector along v — v'. Transformation of the velocities 
conserves the total momentum of the pair of colliding particles (v f + w' = 
v + w), and the total kinetic energy ( v' 2 + w' 2 = v 2 + w 2 ). The Boltzmann 
equation reads: 

% + (•” Z)=L L (p{x ■ ’ t>p{x ’ t} 

—P{x , v, t)P(x, m, t)) | (w — v,n) \ d w d n , (2.1) 


Alexander N. Gorban and Iliya V. Karlin: Invariant Manifolds for Physical and Chemical 
Kinetics , Lect. Notes Phys. 660 , 21-63 (2005) 
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where integration in w is carried over the whole space i? 3 , while integration in 
n is over a hemisphere B~ = {n G S 2 \ (w — v,n)< 0} . This inequality (w — 
v,n) < 0 corresponds to the particles entering the collision. The nonlinear 
integral operator in the right hand side of (2.1) is nonlocal in the velocity 
variable, and local in space. The Boltzmann equation for arbitrary hard-core 
interaction is a generalization of the Boltzmann equation for hard spheres 
under the proviso that the true infinite-range interaction potential between 
the particles is cut off at some distance. This generalization amounts to a 
replacement, 


cr 2 | (w — v , n) | d n ^ B(0 , | w — v |) dO de , (2.2) 

where the function B is determined by the interaction potential, and the 
vector n is identified with two angles, 6 and 5. In particular, for potentials 
proportional to the n-th inverse power of the distance, the function B reads 

B(6 , | v — w |) = (3(6) | v — w . (2.3) 

In the special case n — 5, function B is independent of the magnitude of the 
relative velocity (Maxwell molecules). Maxwell molecules occupy a distinct 
place in the theory of the Boltzmann equation: they provide exact results. 
Three most important findings for the Maxwell molecules should be men¬ 
tioned: (a) The exact spectrum of the linearized Boltzmann collision inte¬ 
gral, found by Truesdell and Muncaster [261], (b) Exact transport coefficients 
found by Maxwell even before the Boltzmann equation was formulated, (c) 
Exact solutions to the space-free version of the nonlinear Boltzmann equation. 
Galkin [71] found the general solution to the system of moment equations in 
a form of a series expansion, Bobylev, Krook and Wu [255,256,262] found an 
exact solution of a particular elegant closed form, and Bobylev demonstrated 
the complete integrability of this dynamic system [73]. The review of relax¬ 
ation of spatially uniform dilute gases for several types of interaction models, 
of exact solutions and related topics was given in [75]. 

A broad review of the Boltzmann equation and analysis of analytical 
solutions to kinetic models is presented in the book of Cercignani [112]. A 
modern account of rigorous results on the Boltzmann equation is given in the 
book [113]. Proof of the existence theorem for the Boltzmann equation was 
given by DiPerna and Lions [119]. 

It is customary to write the Boltzmann equation using another normal¬ 
ization of the distribution function, /(cc, v, £) dxdv, taken in such a way that 
the function / is compliant with the definition of the hydrodynamic fields: 
the mass density p, the momentum density pu, and the energy density e: 
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Here m is the particle mass. 

The Boltzmann equation for the distribution function / reads, 

(2 - 5) 

where the nonlinear integral operator at the right hand side is the Boltzmann 
collision integral, 

Q=[ [ (f(v')f(w') - f(v)f(w))B(9,v)dwd0de . (2.6) 

JR 3 JB~ 

Finally, we mention the following form of the Boltzmann collision integral 
(sometimes referred to as the scattering or the quasi-chemical representation), 

Q = J W(v,w I v',w')[(f(v')f(w') - f(v)f(w))]dwdw' dv' , (2.7) 

where W is a generalized function which is called the probability density of 
the elementary event, 

W = w(v, w | v f , w')S(v + w — v' — w')S(v 2 + w 2 — v' 2 — w' 2 ) . (2.8) 

2.1.2 The Basic Properties of the Boltzmann Equation 

The generalized function W has the following symmetries: 

W(v',w' | v,w) = W(w',v' | v,w) 
m W(v',w' | w,v) = W(v : w | v'. w') . (2.9) 

The first two identities reflect the symmetry of the collision process with 
respect to labeling the particles, whereas the last identity is the celebrated 
detailed balance condition which is underpinned by the time-reversal symme¬ 
try of the microscopic (Newton’s) equations of motion. The basic properties 
of the Boltzmann equation are: 

1. Additive invariants of the collision operator. 

J Q(f,f)V,v,v 2 }dv = 0 , (2.10) 

for any function /, assuming the integrals exist. Equality (2.10) reflects the 
fact that the number of particles, the three components of particle’s momen¬ 
tum, and the particle’s energy are conserved in collisions. Conservation laws 
(2.10) imply that the local hydrodynamic fields (2.4) can change in time only 
due to redistribution over space. 
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2. The zero point of the integral (Q — 0) satisfies the equation (which is 
also called the detailed balance ): For almost all velocities, 


f(v',x,t)f(w',x,t) = f(v,x,t)f(w,x,t ) . 


3. Boltzmann’s local entropy production inequality : 

a(x,t) =-k B J Q(f, f)lnfdv > 0 , (2.11) 

for any function /, assuming integrals exist. The dimensional Boltzmann’s 
constant (&b ~ 1.3806503 • 10 -23 J/K) in this expression serves for a recalcu¬ 
lation of the energy units into absolute temperature units. Moreover, equality 
holds if In / is a linear combination of the additive invariants of collision. 

Distribution functions / whose logarithm is a linear combination of ad¬ 
ditive collision invariants with coefficients dependent on x, are called local 
Maxwell distribution functions /lm, 


/lm 


p_ f 27t k B T 
m \ m 


-3/2 


exp 


—m(v — u) z 
2 k B T 


( 2 . 12 ) 


Local Maxwellians are parametrized by values of five hydrodynamic vari¬ 
ables, p, u and T. This parametrization is consistent with the definitions 
of the hydrodynamic fields (2.4), f mv, mv 2 /2j dv = (p, pu, e), pro¬ 

vided the relation between the energy and the kinetic temperature T holds, 

* = &**?■ 

4. Boltzmann’s H theorem : The function 


S[f} =-k B J f\nfdv , (2.13) 

is called the entropy density 1 . The local H theorem for distribution functions 
independent of space states that the rate of the entropy density increase is 
equal to the nonnegative entropy production, 


d S 
d t 


= a > 0 . 


(2.14) 


Thus, if no space dependence is considered, the Boltzmann equation de¬ 
scribes relaxation to the unique global Maxwellian (whose parameters are 
fixed by initial conditions), and the entropy density grows monotonically 
along the solutions. Mathematical specifications of this property has been 

1 From the physical point of view the value of the function / can be treated 
as dimensional quantity, but if one changes the scale and multiplies / by a 

positive number is then S[f] transforms into vS[f] + is Inis f f dv. For a closed 
system the corresponding transformation of the entropy is an inhomogeneous 
linear transformation with constant coefficients. 
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initialized by Carleman [259], and many estimations of the entropy growth 
were obtained over the past two decades. In the case of space-dependent 
distribution functions, the local entropy density obeys the entropy balance 
equation : 


dgOM) + (J^,Js(a;,t)) = a(x,t) > 0 , (2.15) 

where J s is the entropy flux, J s (cc, t) = — &b f 1 n/(cc, t)vf(x , £) dv. For suit¬ 
able boundary conditions, such as specularly reflecting or at infinity, the 
entropy flux gives no contribution to the equation for the total entropy , 
Stot = f S(x,t) dx and its rate of changes is then equal to the nonnega¬ 
tive total entropy production (j to t = f cr(x,t ) dx (the global H theorem ). For 
more general boundary conditions which maintain the entropy influx, the 
global H theorem needs to be modified. A detailed discussion of this ques¬ 
tion is given by Cercignani [112]. The local Maxwellian is also specified as 
the maximizer of the Boltzmann entropy function (2.13), subject to fixed 
hydrodynamic constraints (2.4). For this reason, the local Maxwellian is also 
termed the local equilibrium distribution function. 


2.1.3 Linearized Collision Integral 


Linearization of the Boltzmann integral around the local equilibrium results 
in the linear integral operator, 


Lh(v) = J W(v,w | v', w')f hM (v)f hM (w) 
h(v') h(w') h(v) h{w) 


./lm(v') /lm(w') /lm(v) /lmW. 


dw'dv'dw . (2.16) 


The linearized collision integral is symmetric with respect to the scalar prod¬ 
uct defined by the second derivative of the entropy functional, 

J fhu( v ) 9 {v)Lh(v)dv = j f^(v)h(v)Lg(v)dv . 

The operator L is nonpositive definite, 

J fLM(v)h(v) L h{v) dv < 0 , 

where equality holds if the function hf^ is a linear combination of collision 
invariants which characterize the null-space of the operator L. The spectrum 
of the linearized collision integral is well studied in the case of the small angle 
cut-off. 
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2.2 Phenomenology and Quasi-Chemical Representation 
of the Boltzmann Equation 


Boltzmann’s original derivation of his collision integral was based on a phe¬ 
nomenological “bookkeeping” of the gain and loss of probability density in 
the collision process. This derivation postulates that the rate of gain G + 
equals 

G + = f W + {v,w | v\w')f(v')f(w')dv'dw'dw , 


while the rate of loss L is 


L~ = 



v,w | v'dv' dw' dw . 


The form of the gain and of the loss, containing products of one-body 
distribution functions in place of the two-body distribution, constitutes the 
famous Stosszahlansatz. The Boltzmann collision integral follows now as 
(Q = G + — L _ ), subject to the detailed balance for the rates of individ¬ 
ual collisions, 


IE + (u, w | v',w') = W (v,w | v',w') . 


This representation Q = G + — L~ for interactions different from hard 
spheres requires also the cut-off of functions [3 (2.3) at small angles. The 
gain—loss form of the collision integral makes it evident that the detailed 
balance for the rates of individual collisions is sufficient to prove the local H 
theorem. A weaker condition which is also sufficient to establish the H theo¬ 
rem was first derived by Stueckelberg [114] (so-called semi-detailed balance ), 
and later generalized to inequalities of concordance [115]: 


J dv' f d w'(W+(v , w | t/, w') — W (v,w | v', w')) > 0 , 
J dv J d w(W + (v . w | v',w') — W (v,w | v',w')) < 0 . 


The semi-detailed balance follows from these expressions if the inequality 
signs are replaced by equalities. 

The pattern of Boltzmann’s phenomenological approach is often used 
to construct nonlinear kinetic models. In particular, nonlinear equations of 
chemical kinetics are based on this idea: If n chemical species Ai participate 
in a complex chemical reaction, 


^ ^ ^si^i ^ ^ ^ fisiA-i , 
i i 


where a s i and (3 S i are nonnegative integers (stoichiometric coefficients) then 
equations of chemical kinetics for the concentrations of species Cj are written 
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d Cj 

d t 


n 

^si) 

s= 1 


vt ex P 




Functions <p+ and <p~ are interpreted as constants of the forward and 
reverse reactions, respectively, while the function G is an analog of the Boltz¬ 
mann’s H- function. 

Modern derivations of the Boltzmann equation, initialized by the seminal 
work of Bogoliubov [2], seek a replacement condition for the Stosszahlansatz 
which would be more closely related to many-particle dynamics. Different 
conditions has been formulated by Zubarev [195], Lewis [281] and others. 
The advantage of these formulations is the possibility to systematically find 
corrections not included in the Stosszahlansatz. 


2.3 Kinetic Models 

Mathematical complications caused by the nonlinear Boltzmann collision in¬ 
tegral are traced back to the Stosszahlansatz. Several approaches were devel¬ 
oped in order to simplify the Boltzmann equation. Such simplifications are 
termed kinetic models. Various kinetic models preserve only certain features 
of the Boltzmann equation, while sacrificing the rest of them. The best known 
kinetic model is the nonlinear Bhatnagar-Gross-Krook model (BGK) [116]. 
The BGK collision integral reads: 

Qbgk =-(/ /lm(/)) • 

T 

The time parameter r > 0 is interpreted as a characteristic relaxation time 
to the local Maxwellian. The BGK collision integral is a nonlinear operator: 
The parameters of the local Maxwellian (p, u and T, see (2.12)) are the 
values of the corresponding moments of the distribution function /. This 
nonlinearly is of “lower dimension” than in the Boltzmann collision integral 
because /lm(/) is a nonlinear function of only the moments of / whereas 
the Boltzmann collision integral is nonlinear in the distribution function / 
itself. This type of simplification introduced by the BGK approach is closely 
related to the family of the so-called mean-field approximations in statistical 
mechanics. 

By its construction, the BGK collision integral preserves the following 
three properties of the Boltzmann equation: additive invariants of collision, 
uniqueness of the equilibrium, and the H theorem. 

A class of kinetic models which generalized the BGK model to quasi- 
equilibrium approximations of a general form is described as follows: The 
quasiequilibrium /* for the set of linear functionals M(/) is a distribution 
function v ) which maximizes the entropy under fixed values of the 
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functionals M. The quasiequilibrium (QE) models are characterized by the 
collision integral [117], 


q qe (/) = -![/- rmm +Qirmn),/'mm. ( 2 . 17 ) 


The first term in (2.17) describes the relaxation to the quasiequiulibrium 
manifold {f*(M)(x,v)} (parametrized by the values of the moments M), 
and the second term is the quasiequilibrium approximation for the Boltzmann 
collision integral, that is, the value of the Boltzmann collision integral on the 
quasiequilibrium distribution. If the set of moment M is p, u and T then the 
quasiequilibrium model (2.17) turns into the BGK model (2.17) 

Same as in the case of the BGK collision integral, operator Qqe is non¬ 
linear in the moments M only. The QE models preserve the following prop¬ 
erties of the Boltzmann collision operator: additive invariants, uniqueness of 
the equilibrium, and the H theorem, provided the relaxation time r to the 
quasiequilibrium is sufficiently small [117]. 

A different nonlinear model was proposed by Lebowitz, Frisch and Helfand 


[118] ; 



The collision integral has the form of the self-consistent Fokker-Planck opera¬ 
tor, describing diffusion (in the velocity space) in the self-consistent potential. 
Diffusion coefficient D > 0 may depend on the distribution function /. Op¬ 
erator Qd preserves the same properties of the Boltzmann collision operator 
as the BGK model. 

The kinetic BGK model has been used to obtain exact solutions of gas- 
dynamic problems, especially for stationary problems. The linearized BGK 
collision model has been extended to model more precisely the linearized 
Boltzmann collision integral [112]. 

2.4 Methods of Reduced Description 

One of the major issues raised by the Boltzmann equation is the problem of 
the reduced description. The equations of hydrodynamics constitute a closed 
set of equations for the hydrodynamic fields (local density, local momentum, 
and local temperature). From the standpoint of the Boltzmann equation, 
these quantities are low-order moments of the one-body distribution func¬ 
tion, or, in other words, macroscopic variables. The problem of the reduced 
description consists in the following questions: 

1. What are the conditions under which the macroscopic description is valid? 

2. What macroscopic variables are relevant for this description? 
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3. How can we derive equations for the macroscopic variables from the kinetic 
equations? 

The classical methods of reduced description for the Boltzmann equation are 
the Hilbert method, the Chapman-Enskog method, and the Grad moment 
method. 


2.4.1 The Hilbert Method 


In 1911, David Hilbert introduced the notion of normal solutions, 
fn(v, n(x, t), u(x,t), T(x,t )) , 


that is, solutions to the Boltzmann equation which depend on space and time 
only through five hydrodynamic fields [16] 

J f(x,v,t)dv = n(x,t),J vf(x, v, t) dv = n(cc, t)u(x, t) , 
v, t ) di> = -n( x, t)k B T . 

The normal solutions are found from a singularly perturbed Boltzmann 
equation, 


Dtf= |Q(/, /) , 


(2.18) 


where e is a small parameter, and 




Physically, parameter e corresponds to the Knudsen number, the ratio be¬ 
tween the mean free path of the molecules between collisions, and the charac¬ 
teristic scale of variation of the hydrodynamic fields. In the Hilbert method, 
one seeks functions n(cc,£), n(cc,t), T(cc,t), such that the normal solution in 
the form of the Hilbert expansion, 


oo 

/H = E £i /H } (2-19) 

i =0 

satisfies (2.18) order by order. Hilbert was able to demonstrate that this is 
formally possible. Substituting (2.19) into (2.18), and matching various order 
in £, we obtain the sequence of integral equations 

Wh 0) ./h 0) ) = 0, 

l/4 1} = a/4 0 } , 

^/h ) =a/4 1) -2Q(/4 0) ,/4 1) ). 


( 2 . 20 ) 

( 2 . 21 ) 

( 2 . 22 ) 
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and so on for higher orders. Here L is the linearized collision integral. From 
(2.20), it follows that is the local Maxwellian with parameters not yet 
determined. The Fredholm alternative, as applied to (2.21) results in: 

(a) Solvability condition, 

J Dtf^{l,v,v 2 }dv = 0 , 

which is the set of the compressible Euler equations of the non-viscous hy¬ 
drodynamics. The solution of the Euler equation determines the parameters 
of the Maxwellian 

(b) General solution ^T/^ 2 , where f^ 1 is the special solution 

(-1 \Q 

to the linear integral equation (2.21), and is a yet undetermined linear 
combination of the additive invariants of collision. 

(c) Solvability condition to the next equation (2.22) determines coeffi¬ 
cients of the function f^ 2 in terms of solutions to linear hyperbolic differ¬ 
ential equations, 

f A(/h } 1 + /H )2 ){l,«,u 2 }d-y = 0 . 

Hilbert was able to demonstrate that this procedure of constructing the nor¬ 
mal solution can be carried out to arbitrary order n, where the function f^ 
is determined from the solvability condition at the next, (n + l)-th order. 
In order to summarize, implementation of the Hilbert method requires solu¬ 
tions for the functions n(cc,t), 'u(ayt), and T(ay£) obtained from a sequence 
of partial differential equations. 

2.4.2 The Chapman—Enskog Method 

A completely different approach to the reduced description was invented in 
1917 by David Enskog [120], and independently by Sidney Chapman [70]. The 
key idea was to seek an expansion of the time derivatives of the hydrodynamic 
variables rather than seeking the time-space dependence of these functions, 
as in the Hilbert method. 

The Chapman-Enskog method starts also with the singularly perturbed 
Boltzmann equation, and with the expansion 

oo 

/cE = £e”/& ) . 

n =0 

However, the procedure of evaluation of the functions differs from the 
Hilbert method: 

Q(f cep / ce ) = 0 ’ 

LfSl = + («> f { ci 


(2.23) 

(2.24) 
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The operator /dt is defined from the expansion of the right hand side of 
the hydrodynamic equations, 


d (°) 

— {p,pu,e} 



(2.25) 


Prom (2.23), function is again the local Maxwellian, whereas (2.25) are 
the Euler equations, and /dt acts on various functions g(p, pu, e ) accord- 
ing to the chain rule, 


g(o) dgd (o) dg 0(o) dgd (o ) 

~dt 9 ~ d^~df P + d(pu)~dT^ + folk 6 


while the time derivatives of the hydrodynamic fields are expressed using 
the right hand side of (2.25). 

The result of the Chapman-Enskog definition of the time derivative , 
is that the Fredholm alternative is satisfied by the right hand side of (2.24). 
Finally, the solution to the homogeneous equation is set to zero by the require¬ 
ment that the hydrodynamic variables as defined by the function / 
coincide with the parameters of the local Maxwellian /(°): 

J {1,«, u 2 }/ce d« = 0 . 

The first correction of the Chapman-Enskog method adds the terms 

^{p,pu,e} = - J (m, mv, } («> j^) fci d « 


to the time derivatives of the hydrodynamic fields. These terms correspond 
to the dissipative hydrodynamics where viscous momentum transfer and heat 
transfer are in the Navier-Stokes and Fourier form. The Chapman-Enskog 
method was the first true success of the Boltzmann equation since it made 
it possible to derive macroscopic equations without a priori guessing (the 
generalization of the Boltzmann equation onto mixtures predicted existence of 
the thermodiffusion before it has been found experimentally), and to express 
transport coefficients in terms of microscopic particles interaction. 2 

However, higher-order corrections of the Chapman-Enskog method, re¬ 
sulting in hydrodynamic equations with higher derivatives (Burnett hydro- 
dynamic equations) face severe difficulties both from the theoretical, as well 
as from the practical point of view. In particular, they result in unphysical 
instabilities of the equilibrium. 

2 For all of the reduction methods many properties of the gas, from the charac¬ 
teristics of the velocity distribution function to the transport coefficients, may 
be expressed in terms of functions of the collision integral (kinetic integrals). 
Although the evaluation of these functions is conceptually straightforward, tech¬ 
nically it is frequently rather cumbersome. Now the methods for the analytical 
evaluation of kinetic integrals using computer algebra are developed [121]. 
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2.4.3 The Grad Moment Method 

In 1949, Harold Grad extended the basic assumption of the Hilbert and the 
Chapman-Enskog methods (the space and time dependence of normal so¬ 
lutions is mediated by the five hydrodynamic moments) [201]. A physical 
rationale behind the Grad moment method is an assumption of the decom¬ 
position of motions: 

1. During the time of order r, a set of distinguished moments M' (which 
include the hydrodynamic moments and a subset of higher-order moments) 
does not change significantly in comparison to the rest of the moments M" 
(the fast dynamics). 

2. Towards the end of the fast evolution, the values of the moments M" 
become unambiguously determined by the values of the distinguished mo¬ 
ments M '. 

3. On the time of order 0 r, dynamics of the distribution function is 
determined by the dynamics of the distinguished moments while the rest 
of the moments remain to be determined by the distinguished moments 
(the slow evolution period). 

Implementation of this picture requires an ansatz for the distribution 
function in order to represent the set of states visited in the course of the 
slow evolution. In Grad’s method, these representative sets are finite-order 
truncations of an expansion of the distribution functions in terms of Hermite 
velocity tensors: 


) = fhM(p,u,e,v ) 


N 

1 + '52 a (a)(M’)H (a) (v - u) 
O) 


(2.26) 


where H^(v — u ) are Hermite tensor polynomials, orthogonal with the 
weight /lm, while coefficient are known functions of the distin¬ 

guished moments M '. Other moments are assumed to be functions of M': 
M" = 

Slow evolution of distinguished moments is found upon substitution of 
(2.26) into the Boltzmann equation and finding the moments of the result¬ 
ing expression ( Grad’s moment equations). Following Grad, this very simple 
approximation can be improved by extending the list of distinguished mo¬ 
ments. The best known is Grad’s thirteen-moment approximation where the 
set of distinguished moments consists of the five hydrodynamic moments, 
the five components of the traceless stress tensor Oij = f m[(vi — Ui)(vj — 
u j ) — Sij(v — u) 2 /3\f du, and of the three components of the heat flux vector 
Qi = J (vi ~ Ui)m(v - u) 2 /2f du. 

The decomposition of motions hypothesis cannot be evaluated for its va¬ 
lidity within the framework of Grad’s approach. It is not surprising therefore 
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that Grad’s methods failed to work in situations where it was (unmotivat- 
edly) supposed to, primarily, in phenomena with sharp time-space depen¬ 
dence such as the strong shock waves. On the other hand, Grad’s method 
was quite successful for describing transition between parabolic and hyper¬ 
bolic propagation, in particular, the second sound effect in massive solids at 
low temperatures, and, in general, situations slightly deviating from the clas¬ 
sical Navier-Stokes-Fourier domain. Finally, the Grad method has been im¬ 
portant background for the development of phenomenological nonequilibrium 
thermodynamics based on a hyperbolic first-order equation, the so-called EIT 
(extended irreversible thermodynamics [235,236]). 

2.4.4 Special Approximations 

Special approximations to the solutions of the Boltzmann equation were 
found for several problems, which perform better than the results of “regu¬ 
lar” procedures. The best known is the Tamm-Mott-Smith ansatz introduced 
independently by Mott-Smith and Tamm for the strong shock wave problem: 
The (stationary) distribution function is represented as 

fTMs(a(x)) = (1 - a(x))f+ + a(x)f _ , (2.27) 

where f± are upstream and downstream Maxwell distribution functions, and 
a(x) is an undetermined scalar function of the coordinate along the shock 
tube. 

Equation for the function a(x) is obtained upon substitution of (2.27) 
into the Boltzmann equation, and integration with some velocity-dependent 
function (p(v). Two general problems arise with the special approximation 
thus constructed: which function <p(v) should be taken, and how to find a 
correction to an ansatz like (2.27)? 

2.4.5 The Method of Invariant Manifold 

The general problem of reduced description for dissipative system was recog¬ 
nized as the problem of finding stable invariant manifolds in the space of 
distribution functions [9,11,12,14]. The notion of invariant manifold general¬ 
izes the normal solution in the Hilbert and in the Chapman-Enskog method, 
and the finite-moment sets of distribution function in the Grad method: If 12 
is a smooth manifold in the space of distribution functions, and if fn is an 
element of 12, then 12 is invariant with respect to the dynamic system, 

^ = J(f) , (2-28) 

if J{fa) e T fo Q, for all f n e (2 , (2.29) 

where T fn 12 is the tangent space of the manifold 12 at the point /q. Ap¬ 
plication of the invariant manifold idea to dissipative systems is based on 
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iterations, progressively improving the initial approximation, and it involves 
the following steps: construction of the thermodynamic projector and itera¬ 
tions for the invariance condition 

Thermodynamic Projector 

Given a manifold 12 (not obligatory invariant), the macroscopic dynamics on 
this manifold is defined by the macroscopic vector field, which is the result of a 
projection of vectors J(fn) onto the tangent bundle T12. The thermodynamic 
projector PJ^ takes advantage of dissipativity: 

kerP;„ C ker D f S \ Ja , (2.30) 

where DfS \ f n is the differential of the entropy evaluated in fn- 

This condition of thermodynamicity means that the projector P^ deter¬ 
mines a decomposition of motion near 12: fn + ker PJ n is the plane of fast 
motion, and imP^ is the tangent space to fn, we assume that the motion 
along 12 is slow. Each state of the manifold 12 can be considered as the re¬ 
sult of the fast relaxation. During the fast motion the entropy should grow. 
Hence, the state fn is the maximum entropy state on the plain of fast motions 
/„+kerP;„. 

The condition of thermodynamicity (2.30) does not define the projector 
completely; rather, it is the condition that should be satisfied by any projector 
used to define the macroscopic vector field, J' Q = Pf n J(fn)- For, once the 
condition (2.30) is met, the macroscopic vector field preserves dissipativity 
of the original microscopic vector field J(f): 

D f S \ fo -Pf n (J(fn)) > 0 for all /„ e (1 . (2.31) 

Nevertheless, the thermodynamic projector is uniquely defined by the re¬ 
quirement dissipativity preservation (2.31) for all the dissipative vector field 
with the given entropy (see Chap. 5 and [10]). 

The thermodynamic projector is the formalization of the assumption that 
12 is the manifold of slow motion: If a fast relaxation takes place at least in 
a neighborhood of 12, then the states visited in this process before arriving 
at fn belong to kerP^. In general, P ^ depends in a non-trivial way on fn . 

Iterations for the Invariance Condition 

The invariance condition for the manifold 12 reads, 

Pn(J(fn)) - J(fn) = 0 , 

here Pn is arbitrary (not obligatory thermodynamic) projector onto the tan¬ 
gent bundle of 12. The invariance condition is considered as an equation 
which is solved iteratively, starting with an initial approximation 12 q. On the 
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(n + 1)—st iteration, the correction /( n+1 ) = /( n ) + $jO+i) i s found from 
linear equations, 


D f J*6f (n+1) = P* n J(/ (n) ) - J(/ (n) ) , 

p*§f(n+i) = 0 ( (2.32) 


where DfJ* is the linear self-adjoint operator with respect to the scalar 
product by the second differential of the entropy D^S \f(n). 

Together with the above-mentioned principle of thermodynamic projec¬ 
tion, the self-adjoint linearization implements the assumption about the de¬ 
composition of motions around the n’th approximation. The self-adjoint lin¬ 
earization of the Boltzmann collision integral Q (2.7) around a distribution 
function / is given by the formula, 


DfQ SYM 5f = J W(v,w,\v',w') 




8f(v’) + Sf(w') 6f(v) 6f(w) 


/(«') f(w') f(v) f(w) 


d w' dv' d w 


(2.33) 


If / = /lm, the self-adjoint operator (2.33) becomes the linearized colli¬ 
sion integral. 

The method of invariant manifold is the iterative process: 

U {n \P*n) -> (f in+1 \K) -> (f in+1 \P:+ 1 ) 

On the each first step of the iteration, the linear equation (2.32) is solved with 
the projector known from the previous iteration. On the each second step, the 
projector is updated, following the thermodynamic construction. The method 
of invariant manifold can be further simplified if smallness parameters are 
known. 


2.4.6 Quasiequilibrium Approximations 

Important generalization of the Grad moment method is the concept of the 
quasiequilibrium approximations already mentioned above (we discuss this 
approximation in detail in Chap. 5). The quasiequilibrium distribution func¬ 
tion for a set of distinguished moments M = m(f) maximizes the entropy 
density S for fixed M. The quasiequilibrium manifold i?*(M) is the collec¬ 
tion of the quasiequilibrium distribution functions for all admissible values of 
M. The quasiequilibrium approximation is the simplest and extremely useful 
(not only in the kinetic theory itself) implementation of the hypothesis about 
a decomposition of motions: If M are considered as slow variables, then states 
which could be visited in the course of rapid motion in the vicinity of i?*(M) 
belong to the planes 
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r M = {f\m(f-f*(M))=0}. 


In that respect, the thermodynamic construction in the method of invari¬ 
ant manifold is a generalization of the quasiequilibrium approximation where 
the given manifold is equipped with a quasiequilibrium structure by choos¬ 
ing appropriately the macroscopic variables of the slow motion. In contrast 
to the quasiequilibrium, the macroscopic variables thus constructed are not 
obligatory moments. A textbook example of the quasiequilibrium approx¬ 
imation is the generalized Gaussian function for M = {p, pn, P}, where 
Pij = f ViVjf dv is the pressure tensor. 

The thermodynamic projector P* for a quasiequilibrium approximation 
was first introduced by B. Robertson [126] (in a different context of conserv¬ 
ative dynamics and for a special case of the Gibbs-Shannon entropy). It acts 
on a function P as follows 



where M = J rriifdv. The quasiequilibrium approximation does not exist if 
the highest order moment is an odd-order polynomial of velocity (therefore, 
there exists no quasiequilibrium for thirteen Grad’s moments), and a regular¬ 
ization is then required. Otherwise, the Grad moment approximation is the 
first-order expansion of the quasiequilibrium around the local Maxwellian. 

2.5 Discrete Velocity Models 

If the number of microscopic velocities is reduced drastically to only a finite 
set, the resulting discrete velocity models, continuous in time and in space, 
can still mimic gas-dynamic flows. This idea was introduced in Broadwell’s 
paper in 1963 to mimic the strong shock wave [122]. 

Further important development of this idea was due to Cabannes and 
Gatignol in the seventies who introduced a systematic class of discrete ve¬ 
locity models [129]. The structure of the collision operators in the discrete 
velocity models mimics the polynomial character of the Boltzmann collision 
integral. Discrete velocity models are implemented numerically by using the 
natural operator splitting in which each update due to free flight is followed 
by the collision update, the idea which dates back to Grad. One of the most 
important recent results is the proof of convergence of the discrete velocity 
models with pair collisions to the Boltzmann collision integral [124]. 

2.6 Direct Simulation 

Besides the analytical approach, direct numerical simulation of Boltzmann- 
type nonlinear kinetic equations have been developed since the middle of 
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1960’s, beginning with the seminal works of Bird [127,128]. The basis of 
the approach is a representation of the Boltzmann gas by a set of particles 
whose dynamics is modeled as a sequence of free propagation and collisions. 
The modeling of collisions uses a random choice of pairs of particles inside 
the cells of the space, and changing the velocities of these pairs in such a way 
as to comply with the conservation laws, and in accordance with the kernel of 
the Boltzmann collision integral. At present, there exists a variety of models 
based on this scheme known as the Direct Simulation Monte-Carlo method 
(DSMC) [127,128]. The DSMC, in particular, provides data to test various 
analytical theories. 


2.7 Lattice Gas and Lattice Boltzmann Models 

Since the mid 1980’s, the kinetic-theory based approach to simulate com¬ 
plex macroscopic phenomena such as hydrodynamics has been developed. 
The main idea of the approach is the construction of a minimal kinetic sys¬ 
tem in such a way that their long-time and large-scale limit matches the 
desired macroscopic equations. For this purpose, the fully discrete (in time, 
space, and velocity) nonlinear kinetic equations are considered on sufficiently 
isotropic lattices, where the links represent the discrete velocities of fictitious 
particles. In the earlier version of the lattice methods, the particle-based pic¬ 
ture has been exploited. These models obey the exclusion rule (one or zero 
particle per lattice link) (the lattice gas model [130]). Most of the present 
versions use the distribution function picture, where populations of the links 
are non-integer (the lattice Boltzmann model [131-135]). Discrete-time dy¬ 
namics consists of a propagation step where populations are transmitted to 
adjacent links and collision step where populations of the links at each node 
of the lattice are equilibrated according a certain simple rule. Many of present 
versions use the BGK-type equilibration, where the local equilibrium is con¬ 
structed in such a way as to match desired macroscopic equations. The lattice 
Boltzmann method is a useful approach for computational fluid dynamics, ef¬ 
fectively compliant with parallel architectures. The proof of the H theorem 
for the Lattice gas models is based on the semi-detailed (or Stueckelberg’s) 
balance principle. The proof of the H theorem in the framework of the lat¬ 
tice Boltzmann method has only very recently been achieved [136-141] (see 
below). 


2.7.1 Discrete Velocity Models for Hydrodynamics 

We start with a generic discrete velocity kinetic model. Let be the 

population of D-dimensional discrete velocities c*, i = 1,..., na, at position 
x and time t. The hydrodynamic fields are the first few moments of the 
populations, namely 
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n d 

XT’ a, c 2 i}fi = {p, pu, pDT + pu 2 } , (2.34) 

i= 1 

where p is the mass density of the fluid, pu is the D-dimensional momentum 
density vector, and e = pDT + pu 2 is the energy density. Below, the index 
a = 1,..., D, denotes the spatial components. In the case of athermal hydro¬ 
dynamics, the set of independent hydrodynamic fields contains only the mass 
and momentum densities. It is convenient to introduce nd-dimensional popu¬ 
lation vectors /, and the standard scalar product, (f\g) = x iVi- We will 

describe here the construction of the discrete velocity models for the incom¬ 
pressible hydrodynamics (the most important field of applications), and will 
present the results for a weakly compressible case below. So, let the locally 
conserved fields be density and momentum density, 

(l|/> = P, (Ca\f) = PU a • (2.35) 

Here 1 = {1}™^, v a = {q ck }^ 1 , a = 1,..., D. In this case, the construction 
of the kinetic simulation scheme begins with finding a convex function of 
populations H (entropy function), which satisfies the following condition: 
If / eq (p, u) (local equilibrium) minimizes H subject to the hydrodynamic 
constraints (2.35), then / eq also satisfies certain restrictions on the higher- 
order moments. For example, the equilibrium stress tensor must respect the 
Galilean invariance, 


n d 

V CiaCipfi q (p,u) = pc 2 s a p + pu a up . (2.36) 

i =1 

Here c s is the speed of sound. The corresponding entropy functions for the 
athermal and thermal cases are given below (see Table 2.1 and Table 2.2). 
For the time being, assume the convex function H is fixed. 

The next step is to write down the set of kinetic equations, 

dtfi + c ia d a fi = A i . (2.37) 


Table 2.1. Reconstruction of macroscopic dynamics with the increase of the order 
of the Hermite polynomial 


Order of 
Polynomial 

Independent 

Variables 

Discrete 
Velocities (ID) 

Weights Target Equation 

2 

P 

±1 

1 

2 

Diffusion 

3 

P: pu 

o, ±VTT 0 

2 1 

3 ’ 6 

Athermal Navier-Stokes, 0(u 2 ) 

4 

P, pu, e 

=b a, zb b 

T 0 

4 a 2 5 

Thermal Navier-Stokes, O(0 2 ) 
Athermal Navier-Stokes, 0(u 3 ) 
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Table 2.2. Reconstruction of higher-order moments, in comparison to the contin¬ 
uous case. Symbol A denotes the difference from the continuous case 



AP™ 

Oifj 


*RZ 

Athermal case 
Thermal case* 

OO 

IT IT 

oo ^ 

0(u 3 ) 

O(u0 2 ), O(u 3 0 ), and 0(u 5 ) 

0(0 2 ), O(u 2 0 2 ), and 0(u 4 ) 


*0 = (Tq — T)/Tq is the deviation of the temperature from the reference value. 


For a generic case of n c locally conserved fields Mi = i = 1,... , n c , 

n c < nd, the nd-dimensional vector function A (collision integral), must 
satisfy the conditions: 

(rrii\A) = 0 (local conservation laws) , 

a = (VH\A) < 0 (entropy production inequality) . 

Here ViJ is the row-vector of partial derivatives dH/dfi. Moreover, the local 
equilibrium vector / eq must be the only zero point of A, that is, A(f eq ) = 0, 
and, finally, / eq must be the only zero point of the local entropy production, 
cr(/ eq ) = 0- Collision integral which satisfies all these requirements is called 
admissible. Let us discuss several possibilities of constructing admissible col¬ 
lision integrals. 

BGK Model 

Suppose the entropy function H known. If, in addition, the local equilib¬ 
rium is also known as an explicit function of locally conserved variables (or 
some reliable approximation of this function is known), the simplest option 
is to use the Bhatnagar-Gross-Krook (BGK) model. In the case of athermal 
hydrodynamics, for example, we write 

A = (2.38) 

The BGK collision operator is sufficient for many applications. However, 
it becomes advantageous only if the local equilibrium is known in a closed 
form. In other cases only the entropy function is known but not its minimizer. 
For those cases one should construct collision integrals based solely on the 
knowledge of the entropy function. We here present two particular realizations 
of the collision integral based on the knowledge of the entropy only. 

Quasi-Chemical Model 

Let m i,..., m nc be the nd-dimensional vectors of locally conserved fields, 
Mi = (rrii | /), i = 1,..., n c , and let g s , s = 1,..., nd — n c , be a basis 
of the subspace orthogonal (in the standard scalar product) to vectors of 








40 


2 The Source of Examples 


conservation laws. For each vector g s , we define a decomposition g s = gf — 
g ~, where all components of vectors gf are nonnegative, and if ^ 0, then 
gf i = 0. Let us consider the collision integral of the form: 

n d -n c 

A = 7s<7 s {exp [(VH\g;)] - exp [(VH\gf)}} . (2.39) 

S = 1 

Here 7 S > 0. By the construction, the collision integral (2.39) is admissible. 
If the entropy function is Boltzmann-like, and the components of vectors g s 
are integers, the collision integral assumes the familiar Boltzmann-like (or 
mass action law) form. 

Single Relaxation Time Gradient Model 

The BGK collision model (2.38) has the important property: linearization of 
the operator (2.38) at the local equilibrium point has a very simple spectrum 
{0, —1 /t}, where 0 is the n c -times degenerated eigenvalue corresponding to 
the conservation laws, while the eigenvalue —1 /t corresponds to all the rest 
of the (kinetic) eigenvectors. Nonlinear collision operators which have this 
property of their linearizations at equilibrium are called single relaxation 
time models (SRTM). They play an important role in modelling because 
they allow for the simplest identification of transport coefficients. 

The SRTM, based on the given entropy function iL, is constructed as 
follows (single relaxation time gradient model, SRTGM). For the system with 
n c local conservation laws, let e s , s = 1,..., — n c , be an orthonormal basis 

in the kinetic subspace, (m/e s ) = 0, and (e s \e p ) = S sp . Then the single 
relaxation time gradient model is 

h n d —n c 

A = — V e s K sp (f)(e p \VH) , (2.40) 

T 

where K sp are elements of a positive definite ( n d — n c ) x (n^ — n c ) matrix K, 

K(/) = C~\f) , (2.41) 

C sp {f) = (e s \VVH(f)\e p ) . 

Here WiL(/) is the n d x n d matrix of second derivatives, d 2 H / dfidfj. 
Linearization of the collision integral at equilibrium results in the form, 

1 n d -n c 

L = -- ef>es ’ ( 2 - 42 ) 
S = 1 

and is obviously single relaxation time. Use of the SRTGM instead of the 
BGK model results in the equivalent hydrodynamics even when the local 
equilibrium is not known in a closed form. 
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ii-Functions of Minimal Kinetic Models 

The Boltzmann H -function written in terms of the one-particle distribu¬ 
tion function F(sc, c) is H = f F In Fdc, where c is the continuous velocity. 
Close to the local equilibrium, this integral can be approximated by using the 
Gauss-Hermite quadrature. This gives the entropy functions of the discrete- 
velocity models, 

*W i} =E/iln (£) • ( 2 - 43 ) 

Here Wi is the weight associated with the i-th discrete velocity c*, while the 
particles mass and BoltzmamTs constant fee are set equal to one. The discrete- 
velocity distribution functions (populations) fi(x) are related to the values 
of the continuous distribution function at the nodes of the quadrature by the 
formula, 

/»(*) = w i (2nTo) < ' D/2) exp(c*/(2T 0 ))F(x,Ci) . 

The discrete-velocity entropy functions (2.43) for various {wi, c^} is the single 
input for all the constructions of the minimal kinetic models. The set of 
discrete velocities corresponds to zeroes of the Hermite polynomials. 

As the order of the Hermite polynomials used in the quadrature is in¬ 
creased (this corresponds to increasing the number of discrete velocities), the 
discrete H -functions H{ WiiC .y (2.43) become a better approximation. Thus, 
with the increase of the order of the Hermite polynomials, a better approxi¬ 
mation to the hydrodynamics is obtained as demonstrated in Table 2.1, where 
a = \/3- v^To) 1 / 2 , and b = y/3 + y/6( To) 1 / 2 are the absolute values of 
the roots of the fourth-order Hermite polynomial. In higher dimensions, the 
discrete velocities are products of the discrete velocities in one dimension, 
and the weights are constructed by multiplying the weights associated with 
each component direction. 


Athermal Hydrodynamics 

If the discrete velocities are formed using the roots of the third-order Hermite 
polynomials (see Table 2.1), the Navier-Stokes equation is reproduced up to 
the order 0(u 2 ), and which is sufficient for many hydrodynamic applications. 

As the higher-order moments of the local equilibrium are not enforced 
by the construction, we need to check their behavior. Relevant higher- 
order moments of the equilibrium distribution, required to reproduce the 
hydrodynamics in the long-time large-scale limit are the equilibrium pres¬ 
sure tensor, P®^ = E* the equilibrium third-order moments, 

= E; f^CiaCipCiy, and the equilibrium fourth order moment R = 
Ei c i oi°i pc 2 / 2 eq • For the athermal hydrodynamics, only the equilibrium pres¬ 
sure tensor and the equilibrium third-order moments are required to be 
correctly reproduced in order to recover the Navier-Stokes equations. The 
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deviation of these higher-order moments from the expression for the contin¬ 
uous case is reported in Table 2.2. 

2.7.2 Entropic Lattice Boltzmann Method 

If the set of discrete velocities forms the links of a Bravais lattice (with 
possibly several sub-lattices), then the discretization in time and space of 
the discrete velocity kinetic equations is particularly simple, and it leads to 
the entropic lattice Boltzmann scheme. This happens in the most important 
case of the athermal hydrodynamics. The equation of the entropic lattice 
Boltzmann scheme reads 

fi{x + Vi6t,t + 6t) - fi(x,t) = Pa(f(x,t))Ai(f(x,t)) . (2.44) 

Here St is the discretization time step, /3 G [0,1] is a fixed parameter which 
matches the viscosity coefficient in the long-time large-scale dynamics of the 
kinetic scheme (2.44), while the function of the population vector a defines 
the maximal over-relaxation of the scheme, and is found from the entropy 
condition, 

H(f(x,t) +aA(f(x,t)) = H(f(x,t)) . (2.45) 

The nontrivial root of this equation is found for populations at each lattice site 
at each moment of discrete time. Equation (2.45) ensures the discrete-time 
iL-theorem, and is required in order to stabilize the scheme if the relaxation 
parameter /3 is close to 1. The latter limit is of particular importance in the 
applications of the entropic lattice Boltzmann method because it corresponds 
to the vanishing viscosity, and hence to simulations of high Reynolds number 
flows. The geometrical sense of the over-relaxation is illustrated in Fig. 2.1. 

2.7.3 Entropic Lattice BGK Method (ELBGK) 

An important further simplifications happens in the case of athermal hydro¬ 
dynamics when the entropy function is constructed using third-order Hermite 
polynomials (see Table 2.1). In this case the local equilibrium populations 
vector can be found in a closed form [141]. This enables the simplest en¬ 
tropic scheme - the entropic lattice BGK model - for simulation of athermal 
hydrodynamics. We present this model in the dimensionless lattice units. 

Let D be the spatial dimension. For D = 1, the three discrete velocities 
are 

c = {-1,0,1}. (2.46) 

For D > 1, the discrete velocities are tensor products of the discrete velocities 
of the one-dimensional velocities (2.46). Thus, we have the 9-velocity model 
for D = 2 and the 27-velocity model for D = 3. The H function is Boltzmann- 
like, 
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Fig. 2.1. Entropic stabilization of the lattice Boltzmann scheme with over¬ 
relaxation. Curves represent entropy levels, surrounding the local equilibrium / eq . 
The solid curve L is the entropy level with the value H(f) = H(f *), where f is 
the initial, and /* is the maximally over-relaxed population f + a A. The vector A 
represents the collision integral, the sharp angle between A and the vector — ViL 
reflects the entropy production inequality, while M is the point of minimum of 
H on the segment between / and /*. The point /* M is the solution to (2.45). 
The result of the collision update is represented by the point f(/3). The choice of f3 
shown corresponds to the over-relaxation: H(f(/3)) > H(M) but H(f((3)) < H(f). 
The particular case of the BGK collision (not shown) would be represented by a 
vector Abgk, pointing from / towards / eq , in which case M — / eq 



(2.47) 


The weights Wi are associated with the each of the ith discrete velocity c^. 
For D = 1, the three-dimensional vector of the weights corresponding to the 
velocities (2.46) is 



(2.48) 


For D > 1, the weights are constructed by multiplying the weights associated 
with each component direction. 

The local equilibrium minimizes the H -function (2.43) subject to the fixed 
density and momentum, 



(2.49) 






The explicit solution to this minimization problem reads, 



(2.50) 
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Note that the exponent, in (2.50) takes the values ±1, and 0 only. The 
speed of sound, c s , in this model is equal to The factorization of the 

local equilibrium (2.50) over spatial components is quite remarkable, and 
resembles the familiar property of the local Maxwellians. 

The entropic lattice BGK model for the local equilibrium (2.50) reads, 


fi(x + CiSt,t + St) - fi(x,t) = —f3a(fi(x,t) - f- q (p(f(x,t)),u(f(x,t))) . 

(2.51) 

The parameter /3 is related to the relaxation time r of the BGK model (2.38) 
by the formula, 


0 


St 

2t + St 


(2.52) 


Note that /? depends on the discretization interval St nonlinearly. The value 
of the over-relaxation parameter a is computed on each lattice site at every 
time from the entropy estimate, 


H(f - a(f - / eq (/))) = H{f) . (2.53) 

In the hydrodynamic limit, the model (2.51) reconstructs the Navier-Stokes 
equations with the viscosity 

M = pc 2 s T = pc 2 St . (2.54) 

The zero-viscosity limit corresponds to /3 —> 1. It is the maximal over¬ 
relaxation (see Fig. 2.1). 


Thermal Hydrodynamics 

The minimal entropic kinetic model for the thermal case requires zeroes of 
fourth-order Hermite polynomials (see Table 2.1). This is an off-lattice model 
(discrete velocities at zeroes of the fourth-order Hermit polynomials do not 
form links of any lattice). Therefore, a discretization in space should use other 
methods familiar from the discretization of hyperbolic equations. However, 
the theory of the entropy estimate for the discretization in the time presented 
above is fully applicable in this case too. We here present the local equilibrium 
of the thermal model. 

In order to evaluate Lagrange multipliers in the formal solution to the 
minimization problem, 


/f q = Wi exp [A + B a c ia + Cc 2 ) , 

we note that they can be computed exactly for u = 0 and any temperature 
T within the positivity interval, a 2 < T < b 2 : 
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Ba = 0, Co 


(b 2 - 

( p(6 2 - TT \ 

V(2 w a ) D (b 2 -a 2 ) D ) 



A 0 = log 


-Da 2 Co • 


(2.55) 


With this, the equilibrium at the zero value of the average velocity and the 
arbitrary temperature reads 



(2.56) 


The factorization over spatial components is again clearly visible. Once the 
exact solution for the zero velocity is found, the extension to u ^ 0 is ob¬ 
tained perturbatively. The first few terms of the expansion of the Lagrange 
multipliers are: 



For the numerical implementation, the equilibrium distribution function can 
be calculated analytically up to any order of accuracy required. The accuracy 
of the relevant higher-order moments in this case is shown in the Table 2.2. 
Once the errors in these terms are small, the minimal kinetic models recon¬ 
struct the full thermal hydrodynamic equations. 

While in the athermal case the closeness of the resulting macroscopic 
equations to the Navier-Stokes equations is controlled solely by the deviations 
from zero of the average velocity (low Mach number flows), in the thermal 
regime deviations are also due to variations of the temperature away from the 
reference value. This means that not only the actual velocity should be much 
less than the heat velocity, but also that the temperature deviation from 
To should be small, | T — Tq\/Tq <C 1. However, by increasing the reference 
temperature, one gets a wider range of validity of the present model. Another 
important remark is about the use of the thermal model for the Navier- 
Stokes equation. If the temperature is fixed at the reference value T = T 0 , 
the pressure tensor becomes exact to any purposes of simulation, while the 
third moment becomes exact to the order 0(u 5 ). 

In the construction of the discrete velocity model, the focus is on achieving 
a good approximation of the Boltzmann H- function. Thus, one can expect 
that the correct thermodynamics will be also preserved (within the accuracy 
of the discretization) even in the discrete case. Indeed, the local equilibrium 
entropy, S = for the thermal model satisfies the usual 
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expression for the entropy of the ideal monatomic gas to the overall order of 
approximation of the method, 

S = pk B ln(T D/2 /p^j +O(u 4 ,0 2 ) . (2.57) 


2.7.4 Boundary Conditions 


The boundary (a solid wall) dR is specified at any point x G dR by the 
inward unit normal n, the wall temperature T w and the wall velocity u w . 
The simplest boundary condition for the minimal kinetic models is obtained 
upon evaluation of the diffusive wall boundary condition for the Boltzmann 
equation [112] with the help of the Gauss-Hermite quadrature [142]. The 
explicit expression for the diffusive wall boundary condition in the discrete 
velocity models is 


fi = 


E 


€it-n <0 


!(&' 


E, 


ii’-n <0 


!(&' • n)|/®, q (p w ,Ww) 


. fi (Pwi u w )> 


(€i-n>0), (2.58) 


Here & is the discrete velocity in the wall reference frame, & = — u w . 

Implementation of the diffusive wall boundary condition (2.58) in the context 
of the fully discrete entropic lattice Boltzmann method is given in the paper 
[143]. 


2.7.5 Numerical Illustrations of the ELBGK 

The Kramers problem [112] is a limiting case of the plane Couette flow, where 
one of the plates is moved to infinity, while keeping a fixed shear rate. The 
analytical solution for the slip-velocity at the wall calculated for the linearized 
BGK collision model [112] are compared with the simulation of the entropic 
lattice BGK model in Fig. 2.2. This shows that the important feature of the 
original Boltzmann equation, the Knudsen number dependent slip at the wall 
is retained in the present model. 

In another numerical experiment, the ELBGK method was tested in the 
setup of the two-dimensional Poiseuille flow. The time evolution of the com¬ 
puted profile as compared to the analytical result obtained from the incom¬ 
pressible Navier-Stokes equations is demonstrated in Fig. 2.3. 


2.8 Other Kinetic Equations 

2.8.1 The Enskog Equation for Hard Spheres 

The Enskog equation for hard spheres is an extension of the Boltzmann equa¬ 
tion to moderately dense gases. The Enskog equation explicitly takes into 
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Fig. 2.2. Relative slip at the wall in the simulation of the Kramers problem for 
shear rate a = 0.001, box length L = 32, Voo = a x L = 0.032 (See for details the 
paper [142]) 



Fig. 2.3. Development of the velocity profile in the Poiseuille flow. Reduced ve¬ 
locity U y (x ) = u y /uy max is shown versus the reduced coordinate across the channel 
x. Solid line: Analytical solution. Different lines correspond to different instants of 
the reduced time T m (/i£)/(4R 2 ), increasing from bottom to top, R is the half¬ 
width of the channel. Symbol: simulation with the ELBGK algorithm. Parameters 
used are: viscosity ji — 5.0015 x 10 ~ 5 (/3 = 0.9997), steady state maximal veloc¬ 
ity Uy max — 1.10217 x 10 -2 . Reynolds number Re = 1157. (See for details the 
paper [140]) 


account the nonlocality of collisions through a two-fold modification of the 
Boltzmann collision integral: First, the one-particle distribution functions 
are evaluated at the locations of the centers of spheres, separated by the 
nonzero distance at the impact. This makes the collision integral nonlocal in 
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space. Second, the equilibrium pair distribution function at the contact of 
the spheres enhances the scattering probability. 

Enskog’s collision integral for hard spheres of radius ro is written in the 
following form [70]: 

Q= / [(v-w) ■n]\x(x,x + r 0 n)f(x,v')f(x + 2r 0 n,w') 

Jr 3 Jb- 

— x(cc, x - ron)f(x, v)f(x — 2ron, w)] d w d n , (2.59) 

where x( x iV) is the equilibrium pair-correlation function for given temper¬ 
ature and density, and integration in w is carried over the whole space i? 3 , 
while integration in n is over a hemisphere B~ = {n G S 2 \ (w — v,n) < 0}. 

The proof of the H theorem for the Enskog equation has posed certain 
difficulties, and has led to a modification of the collision integral [145]. 

Methods of solution of the Enskog equation are immediate generalizations 
of those developed for the Boltzmann equation, but there is one additional 
difficulty. The Enskog collision integral is nonlocal in space. The Chapman- 
Enskog method, when applied to the Enskog equation, is supplemented with 
a gradient expansion around the homogeneous equilibrium state. 


2.8.2 The Vlasov Equation 


The Vlasov equation (or kinetic equation for a self-consistent force) is the 
nonlinear equation for the one-body distribution function, which takes into 
account a long-range interaction between particles: 


d_ 

dt 


f+ 




= 0 , 


where F = f @(\ x — x' I) \x-%'\ n ( x ') d x ' i s the self-consistent force. In 
this expression $(| x — x' |) ^-x'\ the microscopic force between the 
two particles, and n(x') is the density of particles, defined self-consistently, 
n(x') = f f(x',v) dv. 

The Vlasov equation is used for the description of collisionless plasmas 
in which case it is complemented by the set of Maxwell equations for the 
electromagnetic field [172]. It is also used for the description of gravitating 
gas. 

The Vlasov equation is an infinite-dimensional Hamiltonian system [146]. 
Many special and approximate (wave-like) solutions to the Vlasov equation 
are known and they describe important physical effects [147]. One of the best 
known effects is the Landau damping [172]: The energy of a volume element 
dissipates with the rate 


Q 


E 


2 oj(fc) d/p 
k 2 dv 
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where /o is the Maxwell distribution function, | E | is the amplitude of the 
applied monochromatic electric field with the frequency uj(k), k is the wave 
vector. The Landau damping is thermodynamically reversible, and it is not 
accompanied with an entropy increase. Thermodynamically reversed to the 
Landau damping is the plasma echo effect. 


2.8.3 The Fokker—Planck Equation 


The Fokker-Planck equation (FPE) is a familiar model in various problems 
of nonequilibrium statistical physics [148-150]. We consider the FPE of the 
form 


dW(x,t) 

~~dt 


d_ 

dx 


D 


W 7r u+ 7T W 

ox ox 


(2.60) 


Here, W(x,t ) is the probability density over the configuration space x at time 
£, while U{x) and D{x) are the potential and the positively semi-definite 
((y,Dy) > 0) diffusion matrix. 

The FPE (2.60) is particularly important in studies of polymer solutions 
[151-153]. 

Let us recall the three properties of the FPE (2.60): 


1. Conservation of the total probability: 



2. The equilibrium distribution, 


W eq oc exp(-U) , 


is the unique stationary solution to the FPE (2.60) for the given total 
probability. 

3. The entropy, 


Spy] = - J W(x,t ) 


In 


W(x,t) 


We q (») 


dx 


(2.61) 


is a monotonically growing function due to the FPE (2.60), and it attaines 
the global maximum at equilibrium. 


These properties become more elicit when the FPE (2.60) is rewritten as 
follows: 


d t W(x,t ) = M w 


5S[W] 
5W(x,t) 5 


(2.62) 


Mw = “vy 
ox 


W(x,t)D(x) — 


where 
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is a positive semi-definite symmetric operator. The form (2.62) is the dissi¬ 
pative part of a structure termed GENERIC (the dissipative vector field is a 
metric transform of the entropy gradient) [154,155]. 

Entropy does not depend on kinetic constants. It is the same for differ¬ 
ent details of kinetics, and depends only on the equilibrium data. Let us call 
this property “universality ”. It is known that for the Boltzmann equation 
there exists only one universal Lyapunov functional: the entropy (we do not 
distinguish functionals which are related to each other by monotonic trans¬ 
formations). For the FPE there exists a whole family of universal Lyapunov 
functionals. Let h(a) be a convex function of one variable a > 0, h"(a) > 0, 



(2.63) 


The density of production of the generalized entropy Sh, is non¬ 
negative: 



(2.64) 


The most important variants for the choice of h are: 

h{a) = a In a, and Sh is the Boltzmann-Gibbs-Shannon entropy (in the 
Kullback form [156,157]), 

h(a) = a In a — elna, e > 0, and S^ is the maximal family of additive 
entropies [158-160] (these entropies are additive for the composition of 
independent subsystems). 

h(a) = and the family of Tsallis entropies [161,162]. These 

entropies are not additive, but become additive after a nonlinear monoto¬ 
nous transformation. This property can serve as a definition of the Tsallis 
entropies in the class of generalized entropies (2.63) [160]. 

2.9 Equations of Chemical Kinetics 
and Their Reduction 

2.9.1 Dissipative Reaction Kinetics 

We begin with an outline of reaction kinetics (for details see, for exam¬ 
ple, the book [81]). Let us consider a closed system with n chemical species 
Ai,..., A n , participating in a complex reaction. The mechanism of complex 
reaction is represented by the following stoichiometric equations: 


®si Ai + ... + a sn A n /? s iAi + ... + Psn^n , 


(2.65) 


where the index s = 1,..., r enumerates the reaction steps, and the integers, 
a S i and /3 S $, are the stoichiometric coefficients. For each reaction step 8, we 
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introduce n-dimensional vectors a s and (3 S with components a S i and (3 S i. 
The stoichiometric vector , 7 S , has integer components 7 s i = /3 s i — a S i. 

For every an extensive variable Ni , “the number of particles of the 
i-th specie”, is introduced. The concentration of Ai is then c* = Ni/V , where 
V is the volume of the system. 

Given the reaction mechanism (2.65), the kinetic equations read: 

r 

N = VJ(c), J(c) = 5> s tr s (c) , (2.66) 

3 = 1 

where dot denotes the time derivative, and W s is the reaction rate function of 
the sth reaction step. In particular, the mass action law suggests a polynomial 
form for the reaction rates: 

n n 

W s (c) = W+(c) - W~ (c) = kf(T) Hc“ si - k~(T) Ref* , (2.67) 

i= 1 i= 1 

where kJ~(T) and k~(T ) are the constants of the forward and reverse reac¬ 
tions, respectively, of the 8 th reaction step, and T is the temperature. The 
(generalized) Arrhenius equation is the most popular expression for kf(T): 

kf(T) = afT b ± exv(Sf/k B ) exp (-Hf/k B T) , (2.68) 

where af, bf are constants, Hf- are activation enthalpies, and Sf are acti¬ 
vation entropies. 

If the stoichiometric vectors { 7 S } are linearly dependent then the rate 
constants are not independent, but related through the principle of detailed 
balance gives the following connection between these constants: There exists 
a positive vector, c eq (T), such that 

VK+(c eq ) = VK s -(c eq ) for all 8 = 1,..., r . (2.69) 

The necessary and sufficient conditions for the existence of such a c eq can be 
formulated as the system of polynomial equalities for {/^}, (see, for example, 
[81]). 

The reaction kinetics equations (2.66) do not form a closed system, be¬ 
cause the dynamics of the volume V is not yet defined. Four classical con¬ 
ditions for closure of this system are well studied: [/, V = const (isolated 
system, U is the internal energy); H, P = const (thermal isolated isobaric 
system, P is the pressure, H = U + PV is the enthalpy), V, T = const (iso- 
choric isothermal conditions); P, T = const (isobaric isothermal conditions). 
For V, T = const no additional equations and data are needed. Equation 
( 2 . 66 ) can be divided by the constant volume to obtain 

r 

C = 'Pls W s{c) ■ 

s= 1 


(2.70) 
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For non-isothermal and non-isochoric conditions addition formulae are 
needed to derive T and V. For all four classical conditions, the thermody¬ 
namic Lyapunov functions G. for kinetic equations are known: 

U. V = const, Guy = —S/k B ; 

V. T = const, Gyy = F/k B T = U/k B T — S/k B ; 

P, P = const, Gh,p == — S/k B ; 

P, T = const, G P y = G/k B T = H/k B T - S/k B , (2.71) 

where F = U—TS is the free energy (Helmholtz free energy), and G = H—TS 
is the free enthalpy (Gibbs free energy). All the thermodynamic Lyapunov 
functions are normalized to the dimensionless scale (if the number of particles 
is expressed in moles, it is necessary to change k B to R ). All these functions 
decrease with time. For the classical conditions, the corresponding thermo¬ 
dynamic Lyapunov functions can be written in the form: G. (const, N). The 
derivatives dG. (const, N)/dNi are the same functions of c and T for all 
classical conditions: 


Hi(c, T) 


dG,( const, N ) 

m 


Mf em (c,r) 

k B T 


(2.72) 


where //• :hem (c, T) is the chemical potential of species A{. 

Usual G.(const, N) are strictly convex functions of IV, and the matrix 
d/ii/dcj is positively definite. The dissipation inequality 

1 HG 

-^ = (^J)<° (2.73) 

holds. This inequality poses a restriction on possible kinetic laws and on 
possible values of the kinetic constants. 

One of the most important generalizations of the mass action law (2.67) 
is the Marcelin-De Donder kinetic function. This generalization [243, 244] 
is based on ideas from the thermodynamic theory of affinity [245]. Within 
this approach, the functions W s are constructed as follows [244]: For a given 
/x(c, T) (2.72), and for a given reaction mechanism (2.65), we define the gain 
(+) and the loss (—) rates of the sth reaction step as, 


w+ = <p+exp(/^,a s ), W s = <p s exp(/x, f3 J , (2.74) 

where (pf > 0 are kinetic factors, (, ) is the standard inner product (the sum 
of coordinates products). 

The Marcelin-De Donder kinetic function reads: W s = W+ — W~, and 
the right hand side of the kinetic equation (2.66) becomes, 

r 

J = ^2 'Ys&t ex P(M> <*s) ~ exp(|i, /3 a )} . 

S= 1 


(2.75) 
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For the Marcelin-De Donder reaction rate (2.74), the dissipation inequality 
(2.73) is particularly elegant: 

r 

G = ^[Qu, fi s ) - (n, a s )] {</>+ e (M, “ s) - } < 0 . (2.76) 

S=1 

The kinetic factors pf should satisfy certain conditions in order to satisfy the 
dissipation inequality (2.76). A well known sufficient condition is the detailed 
balance: 

<pt = <P7 • (2-77) 

Other sufficient conditions are discussed in detail elsewhere [81,115,163]. 

For ideal systems, the function G . is constructed from the thermody¬ 
namic data of individual species. It is convenient to start from the isochoric 
isothermal conditions. The Helmholtz free energy for an ideal system is 

F = k B T y Nj [In a - 1 + noil + const T ,v , (2.78) 

i 

where the internal energy is assumed to be a linear function of TV in a given 
interval of c, T: 


U = J2 N MT) = N i( u 0 i + GviT) , 

i i 

where Ui(T ) is the internal energy of species Ai per particle. It is well known 
that S = -{dF/dT) VtN=conat , U = F+TS = F-T(dF/dT) v , N=con st , hence, 
Ui(T) = —k B T 2 diioi/dT and 


Moz = + uoi/k B T — (Cvi/k B ) In T , (2.79) 

where Si = const, Cyi is the heat capacity at constant volume (per particle) 
of species 

In concordance with the form of ideal free energy (2.78) the expression 
for is: 

Pi = In Ci + 5i+ u 0i /k B T - ( C Vi /k B ) InT . (2.80) 

For the function p of the form (2.80), the Marcelin-De Donder equation 
obtains the more familiar mass action law form (2.67). Taking into account 
the principle of detailed balance (2.77) we get the ideal rate functions: 

W s (c) = W+(c) - W~ (c) , 

n 

Wj-(c) = Ps{c, T)T~ asiCvi/kB^i OL si (5i+u 0 i/kvT) JJ c a si 

n 

W~ (c) = ^ s (c,T)T _s ‘^ iCrvi/feB e s ‘^ <(ii+ “ 0i/fcBT) Rcf ai . (2.81) 

i =1 
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where (p s (c, T) is an arbitrary positive function (from the thermodynamic 
point of view). 

Let us discuss further the vector field J(c) in the concentration space 
(2.70). Conservation laws (balances) impose linear constraints on admissible 
vectors dc/dt : 


(bi, c) = Bj = const, 



0, i 1,...,/ , 


(2.82) 


where bi are fixed and linearly independent vectors. Let us denote as B the 
set of vectors which satisfy the conservation laws (2.82) for given Bf. 


B = {c|(6i,c) = B u ... ,(b u c) = Bi} . 


The natural phase space X of the system (2.70) is the intersection of the 
cone of n-dimensional vectors with nonnegative components, with the set B , 
and dimX = d = n — l. In the sequel, we term a vector c G X the state 
of the system. In addition, we assume that each of the conservation laws is 
supported by each elementary reaction step, that is 


(7 s ,bi) = 0 , 


(2.83) 


for each pair of vectors 7 S and bi. 

Reaction kinetic equations describe variations of the states in time. The 
phase space X is positive-invariant for system (2.70): If c(0) G X, then 
c(t) G X for all times t > 0. 

In the sequel, we assume that the kinetic equations (2.70) describe evo¬ 
lution towards the unique equilibrium state, c eq , in the interior of the phase 
space X. Furthermore, we assume that there exists a strictly convex function 
G(c) which decreases monotonically in time due to (2.70), VG is the vector 
of partial derivatives dG/dci, and the convexity means that the n x n matrix 

H c = \\d 2 G(c)/dcidcj\\ , (2.84) 

is positive definite for all c G X. In addition, we assume that the matrix 
(2.84) is invertible if c is taken in the interior of the phase space. 

Function G is the Lyapunov function for the system (2.66), and c eq is 
the point of global minimum of G in the phase space X. Otherwise stated, 
the manifold of equilibrium states c eq (T>i,..., Bi) is the solution to the vari¬ 
ational problem, 


G —> min for (bi, c ) = Bi , i = 1,..., l . (2.85) 

For each fixed value of the conserved quantities Bi , the solution is unique. 
In many cases, however, it is convenient to consider the whole equilibrium 
manifold, keeping the conserved quantities as parameters. 

For example, for perfect systems in a constant volume system at constant 
temperature, the Lyapunov function G reads: 
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n 

G = 5 >Kci/cD-l]- (2-86) 


It is important to stress that c eq in (2.86) is an arbitrary equilibrium of 
the system, under arbitrary values of the balances. In order to compute G(c), 
it is unnecessary to calculate the specific equilibrium c eq which corresponds 
to the initial state c. Let us compare the Lyapunov function G (2.86) with the 
classical formula for the free energy (2.78). This comparison gives a possible 
choice for c eq : 


Inc® q = -Si - u 0i /k B T + (CVi/Afe) InT . (2.87) 

2.9.2 The Problem of Reduced Description 
in Chemical Kinetics 

Reduction of a description of a chemical system means the following: 

1. Reduce the number of species. This, in turn, can be achieved in two ways: 

- eliminate inessential species, or 

- lump some of the species into integrated components. 

2. Reduce the number of reactions. This can also be done in several ways: 

- eliminate inessential reactions, those which do not significantly influ¬ 
ence the reaction progress; 

- assume that some of the reactions “have already been completed”, and 
that the equilibrium has been reached along their paths (this leads to 
dimensional reduction because the rate constants of the “completed” 
reactions are not used thereafter, what one needs are equilibrium con¬ 
stants only). 

3. Decompose the motions into fast and slow, into independent (almost- 
independent) and slaved etc. As a result of such a decomposition, the 
system admits a study “in parts”. At the end, the results are combined 
into a joint picture. There are several approaches which fall into this cat¬ 
egory. The famous method of the quasi-steady state (QSS), pioneered by 
Bodenstein and Semenov, follows the Chapman-Enskog method. The par¬ 
tial equilibrium approximations are predecessors of Grad’s method and 
quasiequilibrium approximations in physical kinetics. These two family of 
methods have different physical backgrounds and mathematical forms. 

2.9.3 Partial Equilibrium Approximations 

Quasiequilibrium with respect to reactions is constructed as follows: From the 
list of reactions (2.65), one selects those which are assumed to equilibrate 
first. Let these reactions be indexed with the integers si,_, S&. The quasi¬ 

equilibrium manifold is defined by the system of equations, 

W+ = W~, i = l,...,k. 


(2.88) 


56 


2 The Source of Examples 


This system looks particularly elegant when written in terms of conjugated 
(dual) variables, g = VG: 


(isoV) = 0, (2.89) 

In terms of the conjugated variables, the quasiequilibrium manifold forms a 
linear subspace. This subspace, L x , is the orthogonal completement to the 
linear envelope of vectors, L = lin{ 7 Si ,... ,7 Sfc }. 

Quasiequilibrium with respect to species is constructed practically in the 
same way but without selecting the subset of reactions. For a given set of 
species, ,..., Ai k , one assumes that their concentrations evolve fast to 
equilibrium and remain there. Formally, this means that in the k- dimensional 
subspace of the space of concentrations with coordinates ,..., c$ fc , one con¬ 
structs the subspace L which is defined by the balance equations, (6^, c) = 0. 
In terms of the conjugated variables, the quasiequilibrium manifold, lA, is 
defined by the equations, 

fiei 1 , (M = (Mi> • • •, /■*«)) • (2.90) 

The same quasiequilibrium manifold can also be defined with the help of fic¬ 
titious reactions: Let gq,..., g q be a basis in L. Then (2.90) may be rewritten 
as follows: 

(&,/•*) =0, i = l,...,q . (2.91) 

Illustration: Quasiequilibrium with respect to reactions in hydrogen oxi¬ 
dation: Let us assume equilibrium with respect to the dissociation reactions, 
H 2 2H, and, O 2 ^ 20, in some subdomain of reaction conditions. This 
gives: 

kf Ch 2 = fcr C H> k 2 c 0 2 = k 2 Co ■ 

Quasiequilibrium with respect to species: For the same reactions, let us as¬ 
sume equilibrium over H, O, OH, and H 2 O 2 , in a subdomain of reaction 
conditions. The subspace L is defined by the balance constraints: 

ch + coh + 2ch 2 o 2 = 0, c o + coh + 2ch 2 o 2 = 0 • 

The subspace L is two dimensional. Its basis, {gq,^}? m the coordinates cr, 
Co, coh? and cr 2 o 2 reads: 

0 1 = ( 1 , 1 ,- 1 , 0 ), g 2 = ( 2 , 2 , 0 ,- 1 ). 

Correspondingly (2.91) becomes: 

Mh + ho = Moh, 2/i H + 2/ro = Mh 2 o 2 • 

General construction of the quasiequilibrium manifold : In the space of con¬ 
centrations, one defines a subspace L which satisfies the balance constraints: 


(bi,L)= 0. 
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The orthogonal complement of L in the space with coordinates fi = VG 
defines then the quasiequilibrium manifold 17^. For the actual computations, 
one requires the inversion from (i to c. The duality structure fi c is well 
studied by many authors [163,164]. 

Quasiequilibrium projector. It is not sufficient to just derive the manifold, 
it is also required to define a projector which transforms the vector field 
defined on the space of concentrations into a vector field on the manifold. 
The quasiequilibrium manifold consists of points which minimize G in affine 
spaces of the form c + L. These affine planes are hypothetical planes of fast 
motions (G is decreasing in the course of the fast motions). Therefore, the 
quasiequilibrium projector maps the whole space of concentrations on Ol 
parallel to L. The vector field is also projected onto the tangent space of £2l 
parallel to L. 

Thus, the quasiequilibrium approximation assumes the decomposition of 
motions into fast - parallel to L, and slow - along the quasiequilibrium mani¬ 
fold. In order to construct the quasiequilibrium approximation, the knowledge 
of reaction rate constants of “fast” reactions is not required (stoichiometric 
vectors of all these fast reaction are in L, 7 fast G L, thus, the knowledge of 
L suffices), one only needs some confidence in that they all are sufficiently 
fast [165]. The quasiequilibrium manifold itself is constructed based on the 
knowledge of L and G. The dynamics on the quasiequilibrium manifold is 
defined as the quasiequilibrium projection of the “slow component” of the 
kinetic equations (2.66). 

2.9.4 Model Equations 

The assumption behind quasiequilibrium is the hypothesis of the decomposi¬ 
tion of motions into fast and slow. The quasiequilibrium approximation itself 
describes slow motions. However, sometimes it becomes necessary to restore 
the state of the whole system, and take into account the fast motions as well. 
With this, it is desirable to keep intact one of the important advantages of the 
quasiequilibrium approximation - its independence from the rate constants 
of the fast reactions. For this purpose, the detailed fast kinetics is replaced 
by a model equation ( single relaxation time approximation). 

Quasiequilibrium models (QEM) are constructed as follows: For each con¬ 
centration vector c, consider the affine manifold, c + L. It intersects the 
quasiequilibrium manifold 17^ at a single point. This point delivers the min¬ 
imum to G on c + L. Let us denote this point as c£(c). The equation of the 
quasiequilibrium model reads: 



(2.92) 


slow 


where r > 0 is the relaxation time of the fast subsystem. Rates of slow 
reactions are computed at the points c* L (c) (the second term in the right 
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hand side of (2.92), whereas the rapid motion is taken into account by a 
simple relaxational term (the first term in the right hand side of (2.92). The 
most famous model kinetic equation is the BGK equation in the theory of the 
Boltzmann equation [116]. The general theory of the quasiequilibrium models, 
including proofs of their thermodynamic consistency, was constructed in the 
paper [117]. 

Single relaxation time gradient models (SRTGM) were introduced in the 
context of the lattice Boltzmann method for hydrodynamics [140,166]. These 
models are aimed at improving the obvious drawback of the quasiequilibrium 
model (2.92): In order to construct the QEM, one needs to compute the 
function, 

c£(c) = arg min G(x) . (2.93) 

ccGc+L, sc>0 

This is a convex programming problem, which does not always have a closed- 
form solution. 

Let g l7 ... ,g k be some orthonormal basis of L. We denote as D(c) the 

k x k matrix with elements (g^ H c gj), where H c is the matrix of second 

derivatives of G (2.84). Let C(c) be the inverse of D(c). The single relaxation 
time gradient model has the form: 

k 

c=~l £ 9iC(c)ij(gj,'VG) + Y / ~tsW s (c) . (2.94) 

i,j= 1 slow 

The first term drives the system to the minimum of G on c + L, does not 
require solving problem (2.93), and its spectrum at quasiequilibrium is the 
same as in the quasiequilibrium model (2.92). Note that the slow component 
is evaluated at the “current” state c. 

The first term of equation (2.94) has a simple form 

C = -IgradG + £ 7 s W s (c) , (2.95) 

r z — J 

slow 

if one calculates the gradient gradG E L on the plane of fast motions c + L 
with the entropic scalar product 3 (x,y) = ( x,H c y ). 

The models (2.92) and (2.94) lift the quasiequilibrium approximation to a 
kinetic equation by approximating the fast dynamics with a single “reaction 
rate constant” - the relaxation time r. 

3 Let us remind that gradG is the Riesz representation of the differential of G in 
the phase space X : G(c+Z\c) = G(c) + (gradG(c), Ac)+o(Ac). It belongs to the 
tangent space of X and depends on the scalar product. From the thermodynamic 
point of view, there is only one distinguished scalar product in the concentration 
space, the entropic scalar product. The usual definition of gradG as the vector 
of partial derivatives (VG) corresponds to the standard scalar product (•, •) 
and to the choice X being the whole concentration space. In equation (2.95), 
X = c + L and we use the entropic scalar product. 
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2.9.5 Quasi-Steady State Approximation 

The quasi-steady state approximation (QSS) is a tool used in a large number 
of works. Let us split the species in two groups: The basic and the interme¬ 
diate (radicals etc). Concentration vectors are denoted accordingly, c s (slow, 
basic species), and c f (fast, intermediate species). The concentration vector 
c is the direct sum, c = c s 0 c f . The fast subsystem is (2.66) for the con¬ 
centrations c f at fixed values of c s . If it happens that the so-defined fast 
subsystem relaxes to a stationary state, c f —► Cq SS (c s ), then the assumption 
that c f = Cq SS (c) is precisely the QSS assumption. The slow subsystem is the 
part of system (2.66) for c s , in the right hand side of which the component 
c f is replaced with Cq SS (c). Thus, J = J s ® J f, where 

c f = Jf(c s 0 c f ), c s = const; c f — > Cq SS (c s ) ; (2.96) 

c s = J s (c s ©<4 s (c s )) . (2.97) 

Bifurcations of the system (2.96) under variation of c s correspond to kinetic 
critical phenomena. Studies of more complicated dynamic phenomena in the 
fast subsystem (2.96) require various techniques of averaging, stability analy¬ 
sis of the averaged quantities etc. 

Various versions of the QSS method are possible, and are actually used 
widely, for example, the hierarchical QSS method. There, one defines not a 
single fast subsystem but a hierarchy of them, c fl ,..., c ffc . Each subsystem 
c fi is regarded as a slow system for all the foregoing subsystems, and it is 
regarded as a fast subsystem for the following members of the hierarchy. 
Instead of one system of equations (2.96), a hierarchy of systems of lower¬ 
dimensional equations is considered, each of these subsystem being easier to 
study analytically. 

The theory of singularly perturbed systems of ordinary differential equa¬ 
tions provides the mathematical background and refinements of the QSS 
approximation. In spite of a broad literature on this subject, it remains, in 
general, unclear, what is the smallness parameter that separates the inter¬ 
mediate (fast) species from the basic (slow). Reaction rate constants cannot 
be such a parameter (unlike in the case of quasiequilibrium). Indeed, inter¬ 
mediate species participate in the same reactions, as the basic species (for 
example, H 2 2H, H + O 2 ^ OH + 0). It is therefore incorrect to state 
that c f evolves faster than c s . In the sense of reaction rate constants, c f is 
not faster. 

For catalytic reactions, it is not difficult to figure out what is the smallness 
parameter that separates the intermediate species from the basic, and which 
allows to upgrade the QSS assumption to a singular perturbation theory 
rigorously [81]. This smallness parameter is the ratio of balances: Intermedi¬ 
ate species include a catalyst, and their total amount is simply significantly 
smaler than the amount of all the c£ s. After renormalizing to the variables of 
one order of magnitude, the small parameter appears explicitly. The simplest 
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example is provided by the catalytic reaction A + Z ^ AZ ^ P + Z (here 
Z is a catalyst, A and P are an initial substrate and a product). The kinetic 
equations are (in obvious notations): 

ca = —k± c A c z + k± c AZ , 
cz = —Aq*~ c A c z + Aq caz + k 2 caz ~ k 2 czcp , 
caz = k+c A c z — Aq caz — k 2 c A z + k 2 czcp , 
cp = k 2 CAz — k 2 Czcp . (2.98) 

The constants and the reactions rates are the same for concentrations c A , cp, 
and for cz,c A z , and they cannot be a reason for the relative slowness of 
CAi Cp in comparison with cz,c A z- However, there may be another source 
of slowness. There are two balances for this kinetics: c A + cp + c A z = Ba, 
cz + caz — Pz • Let us switch to the dimensionless variables: 


Sa = ca/Ba , qp = cp/Ba , Sz = cz/Bz , saz = caz/Bz . 
The kinetic system (2.98) is then rewritten as 


k~ 

Sa = Bz —k+^ASz + ~p~^AZ 
Ba 

k~ k+ 

Sz = Ba —k^SASZ + -Py—^AZ + -p-^AZ — k 2 ^z^P 

&A &A 

Bz 

^a T qp T —c,az = 1, sz + saz = 1; > 0 . 

&A 


(2.99) 


For Bz < Ba (the total amount of the catalyst is much smaller than the 
total amount of the substrate) the slowness of <^ 4 , qp is evident from these 
equations (2.99). 

For usual radicals, the origin of the smallness parameter is quite similar. 
There are much less radicals than basic species (otherwise, the QSS assump¬ 
tion is inapplicable). In the case of radicals, however, the smallness parameter 
cannot be extracted directly from the balances Bi (2.82). Instead, one can 
come up with a thermodynamic estimate: Function G decreases in the course 
of reactions, whereupon we obtain the limiting estimate of concentrations of 
any species: 

Ci < max a , ( 2 . 100 ) 

G(c)<G(c(0)) 

where c(0) is the initial composition. If the concentration cr of the radical 
R is small both initially and at equilibrium, then it should also remain small 
along the path to equilibrium. For example, in the case of ideal G (2.86) 
under relevant conditions, for any t > 0 , the following inequality is valid: 


CR[ln(c R (t)/c e R q ) - 1] < G(c(0)) . 


( 2 . 101 ) 
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Inequality (2.101) provides the simplest (but rather crude) thermodynamic 
estimate of cr(£) in terms of G(c(0)) and c^ uniformly for t > 0. The com¬ 
plete theory of thermodynamic estimates of reaction kinetics has been devel¬ 
oped in the book [115]. 

One can also do computations without a priori estimations, if one accepts 
the QSS assumption as long as the values c f stay sufficiently small. It is the 
simplest way to operate with QSS: Just use it as long as c { are small! 

Let us assume that an a priori estimate has been found, Ci(t) < ci max , 
for each c$. These estimates may depend on the initial conditions, thermody¬ 
namic data etc. With these estimates, we are able to renormalize the variables 
in the kinetic equations (2.66) in such a way that the renormalized variables 
take their values from the unit interval [0,1 ]: c* = q/q max . Then the system 
(2.66) can be written as follows: 

^ ■ ( 2 . 102 ) 
di Cl max 

The system of dimensionless parameters, e* = ci max / max^ ci max defines a 
hierarchy of relaxation times, and with its help one can establish various 
realizations of the QSS approximation. The simplest version is the standard 
QSS assumption: Parameters ei are separated in two groups, the smaller ones, 
and those of order 1. Accordingly, the concentration vector is split into c s ®c f . 
Various hierarchical QSS are possible, rendering the problem more tractable 
analytically. 

There exists a variety of ways to introduce the smallness parameter into 
kinetic equations, and one can find applications to each of the realizations. 
However, two particular realizations remain basic for chemical kinetics: 

- Fast reactions (under a given thermodynamic data); 

- Small concentrations. 

In the first case, one is led to the quasiequilibrium approximation, in the 
second, to the classical QSS assumption. Both of these approximations allow 
for hierarchical realizations, those which include not just two but many relax¬ 
ation time scales. Such a multi-scale approach essentially simplifies analytical 
studies of the problem. 


2.9.6 Thermodynamic Criteria 

for the Selection of Important Reactions 

One of the problems addressed by sensitivity analysis is the selection of the 
important and unimportant reactions. In the paper [167] a simple idea was 
suggested to compare the importance of different reactions according to their 
contribution to the entropy production (or, which is the same, according 
to their contribution to dG/dt). Based on this principle, Dimitrov [170] de¬ 
scribed domains of parameters in which the reaction of hydrogen oxidation, 
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H 2 + O 2 + M, proceeds due to different mechanisms. For each elementary reac¬ 
tion, he has derived the domain inside which the contribution of this reaction 
cannot be neglected. Due to its simplicity, this entropy production principle is 
especially well suited for the analysis of complex problems. In particular, re¬ 
cently, a version of the entropy production principle was used in the problem 
of selection of boundary conditions for Grad’s moment equations [168,169]. 
For ideal systems (2.86), as well, as for the Marcelin-De Donder kinetics 
(2.76) the contribution of the 5th reaction to G has a particularly simple 


form: 



(2.103) 


2.9.7 Opening 

One of the problems to focus on when studying closed systems is to extend 
the result for open or driven by flows systems. External flows are usually 
taken into account by additional terms in the kinetic equations (2.66): 


N = VJ(c) + II(c,t) . 


(2.104) 


It is important to stress here that the vector field «7(c) in equations (2.104) 
is the same as for the closed system, with thermodynamic restrictions, Lya¬ 
punov functions, etc. The thermodynamic structures are important for the 
analysis of open systems (2.104), if the external flow U is small in some 
sense, for example, if it is a linear function of c, has small time derivatives, 
etc. There are some general results for such “weakly open” systems, for ex¬ 
ample, the Prigogine minimum entropy production theorem [171] and the 
estimations of possible steady states and limit sets for open systems, based 
on thermodynamic functions and stoihiometric equations [115]. 

There are general results for another limiting case: for very intensive flows 
the dynamics becomes very simple again [81]. Let the flow have a natural 
structure: i7(c, t) = Vi n (t)ci n (t) — v out (t)c(t), where Vi n and v out are the 
rates of inflow and outflow, c^ n (t) is the concentration vector for inflow. If 
v out is sufficiently large, v out (t) > Vo for some critical value Vo and all t > 0, 
then for the open system (2.104) the Lyapunov norm exists: for any two 
solutions c x (t) and c 2 {t) the function ||c 1 (t) — c 2 (t)|| monotonically decreases 
in time. Such a critical value vq exists for any norm, for example, for usual 
Euclidian norm || • || 2 = (•,•). 

For an arbitrary form of iT, the system (2.104) can loose all signs of 
being a thermodynamic one. Nevertheless, thermodynamic structures can 
often help in the study of open systems. 

The crucial questions are: What happens with slow/fast motion separa¬ 
tion after opening? Which slow invariant manifolds for the closed system can 
be deformed to the slow invariant manifolds of the open system? Which slow 
invariant manifold for the closed system can be used as approximate slow 
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invariant manifold for the open system? There exists a more or less useful 
technique to seek answers for specific systems under consideration. We shall 
return to this question in Chap. 13. 

The way to study an open system as the result of opening a closed system 
may be fruitful. Out of this way we have a general dynamical system (2.104) 
and no hints what to do with it. 

The basic introductory textbook on physical kinetics of the Landau and 
Lifshitz Course of Theoretical Physics [172] contains many further examples 
and their applications. 

Modern development of kinetics follows the route of specific numerical 
methods, such as direct simulations. An opposite tendency is also clearly 
observed, and kinetic theory based schemes are increasingly often used for 
the development of numerical methods and models in mechanics of continuous 
media. 


3 Invariance Equation in Differential Form 


Definition of invariance in terms of motions and trajectories assumes, at least, 
existence and uniqueness theorems for solutions of the original dynamical 
system. This prerequisite causes difficulties when one studies equations rel¬ 
evant to physical and chemical kinetics, such as, for example, equations of 
hydrodynamics. Nevertheless, there exists a necessary differential condition 
of invariance : The vector field of the original dynamic system touches the 
manifold at every point. Let us write down this condition in order to set up 
the notation. 

Let E be a linear space, U (the phase space) be a domain in E , and let a 
vector field J : U —> E be defined in U. This vector field defines the original 
dynamical system, 

H 7* 

^ = j(x), xeu. (3.1) 

In the sequel, we consider submanifolds in U which are parameterized by 
a given set of parameters. Let a linear space of parameters L be defined, and 
let IT be a domain in L. We consider differentiable maps, F : IT —> J7, such 
that, for every y G IT, the differential of F, D y F : L —> F, is an isomorphism 
of L on a subspace of F. That is, F are the manifolds, immersed in the phase 
space of the dynamical system (3.1), and parametrized by the parameter set 
W. 

Remark: One never discusses the choice of norms and topologies is such a 
general setting. It is assumed that the corresponding choice is made appro¬ 
priately in each specific case. 

We denote T y the tangent space at point y , T y = ( D y F)(L ). The differ¬ 
ential condition of invariance has the following form: For every y G W, 

J(F(y)) € T y . (3.2) 

Let us rewrite the differential condition of invariance (3.2) in the form of a 
differential equation. In order to achieve this, one needs to define a projector 
P y : E —► T y for every y G W. Once a projector P y is defined, then condition 
(3.2) takes the form: 


4, = (1 - Py)J(F(y )) = 0 • (3.3) 


Alexander N. Gorban and Iliya V. Karlin: Invariant Manifolds for Physical and Chemical 
Kinetics , Lect. Notes Phys. 660, 65-67 (2005) 
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Obviously, by Py = P y we have, P y A y = 0. We refer to the function A y as the 
defect of invariance at point y. The defect of invariance will be encountered 
often in what follows. 

Equation (3.3) is the first-order differential equation for the function F(y). 
Projectors P y should be tailored to the specific physical features of the prob¬ 
lem at hand, and separate chapter below will be devoted to their construction. 
There we shall demonstrate how to construct a projector, P(x, T) : E —> T, 
given a point x G U and a specified subspace T. We then set P y = P(F(y),T y ) 
in equation (3.3) 1 . 

There are two possible meanings of the notion “approximate solution of 
the invariance equations” (3.3): 

1. Approximation of the solution; 

2. The map F with small defect of invariance (the right hand side approxi¬ 
mation). 

The approximation of the first kind requires theorems about existence 
of solutions for the initial system (3.1). In order to find this approximation 
one should estimate the deviations of exact solutions of (3.1) from the ap¬ 
proximate invariant manifold. The second kind of approximations does not 
require the existence of solutions. Moreover, the manifold with sufficiently 
small defect of invariance can serve as a slow manifold by itself. The defect 
of invariance should be small in comparison with the initial vector field J. 

So, we shall accept the concept of approximate invariant manifold (the 
manifold with small defect of invariance) instead of the approximation of 
the invariant manifold (see also [25,349] and other works about approximate 
inertial manifolds). Sometime these approximate invariant manifolds provide 
approximations of the invariant manifolds, sometimes not, but it is additional 
and often difficult problem to make a distinction between these situations. 
In addition to the defect of invariance, Jacobians, the differentials of J(x), 
play the key role in the analysis of motion separation into fast and slow. 
Some estimations of errors of this separation will be presented below in the 
subsection devoted to post-processing. 


1 One of the main routes to define the field of projectors P(x,T) is to make use of 
a Riemannian structure. To this end, one defines a scalar product in E for every 
point x G U, that is, a bilinear form (p\q) x with a positive definite quadratic form, 
(p\p)x > 0, if p ^ 0. A good candidate for such a scalar product is the bilinear 
form defined by the negative second differential of the entropy at the point x , 
— D 2 S(x). As we demonstrate later in this book, close to equilibrium this choice 
is essentially the only correct one. However, far from equilibrium, a refinement 
is required in order to guarantee the thermodymamicity condition, kerP^ C 
ker (D x S) x= F{ y ), for the field of projectors, P(x,T ), defined for any x and T, if 
T (_ ker Pa, S'. The thermodymamicity condition provides the preservation of the 

type of dynamics: if dS/ dt > 0 for initial vector field (3.1) at point x = F(y ), 
then dS/ dt > 0 at this point x for the projected vector field P y (J(F(y))), too. 
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Our discussion is focused on nonperturbative methods for computing in¬ 
variant manifolds, but it should be mentioned that in many applications, the 
Taylor series expansion is in use, and sometimes works quite well. The main 
idea is the continuation of the slow manifold with respect to a small parame¬ 
ter: Let our system depend on the parameter £, and let a manifold of steady 
states and fibers of motions towards these steady states exist for 5 = 0, for 
example 

x = ef(x,y ); y = g(x,y) . (3.4) 

For e = 0, the value of the (vector) variable x is a vector of conserved quan¬ 
tities. Let for every x the equation of fast motion, y = g(x,y), be globally 
stable: Its solution y(t) tends to the unique (for given x) stable fixed point y x . 
If the function g(x,y) meets the conditions of the implicit function theorem, 
then the graph of the map x i—> y x forms a manifold Q o = {(x,y x )} of steady 
states. For small 5 > 0 we can look for the slow manifold in a form of a series 
in powers of 5 : 

= {(x,y(x,e)}, y{x,e) = y x +ey 1 (x) + e 2 y 2 (x) + ... . 

The fibers of fast motions can be constructed in a form of a power series too 
(the zero term is the fast motion y = g(x,y) in the affine planes x = const). 
This analytic continuation with respect to the parameter 6 for small e > 0 is 
studied in the Fenichel’s “Geometric singular perturbation theory” [352,353] 
(recent applications to chemical kinetics see in [95]). As it was mentioned 
above, the first successful application of such an approach for the construction 
of a slow invariant manifold in the form of Taylor series expansion in powers 
of small parameter e was the Chapman-Enskog expansion [70]. 

It is wellknown in various applications that there are many different ways 
to introduce a small parameter into a system, there are many ways to include 
a given system in a one-parametric family. Different ways of specification of 
such a parameter result in different definitions of slowness of positively in¬ 
variant manifold. Therefore it is desirable to study the notion of separation of 
motions without such an artificial specification. The notion of slow positively 
invariant manifold should be intrinsic. At least we should try to invent such 
a notion. 


4 Film Extension of the Dynamics: 
Slowness as Stability 


4.1 Equation for the Film Motion 

One of the difficulties in the problem of reducing the description is caused by 
the fact that there exists no commonly accepted formal definition of slow (and 
stable) positively invariant manifolds. Classical definitions of stability and 
asymptotic stability of the invariant sets sound as follows: Let a dynamical 
system be defined in some metric space (so that we can measure distances 
between points), and let x(t,x o) be a motion of this system at time t with 
the initial condition x(0) = xo at time t = 0. The subset S of the phase space 
is called invariant if it is made of whole trajectories, that is, if xq G S then 
x(t,x o) G S for all t G (—00,00). 

Let us denote as p(x, y) the distance between the points x and y. The 
distance from x to a closed set S is defined as usual: p(x, S) = inf{p(x, y)\y G 
S}. The closed invariant subset S is called stable , if for every e > 0 there exists 
S > 0 such that if p(x 0, S) < S, then for every t > 0 it holds p(x(t , xo ), S') < 
e. A closed invariant subset S is called asymptotically stable if it is stable 
and attractive, that is, there exists e > 0 such that if p(xq,S) < e, then 
p(x(t, xo), S) —> 0 as t —» 00. 

Formally, one can reiterate the definitions of stability and of the asymp¬ 
totic stability for positively invariant subsets. Moreover, since in the defin¬ 
itions mentioned above it goes only about t > 0 or t —► 00, it might seem 
that positively invariant subsets can be a natural object of study concern¬ 
ing stability issues. Such conclusion is misleading, however. The study of the 
classical stability of the positively invariant subsets reduces essentially to the 
notion of stability of invariant sets - maximal attractors. 

Let Y be a closed positively invariant subset of the phase space. The 
maximal attractor for Y is the set My , 

My = p| T t{Y) , (4.1) 

t>0 

where T t is the shift operator for the time t: 


T t {x 0) = x(t,x 0) . 
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4 Film Extension of the Dynamics: Slowness as Stability 


The maximal attractor My is invariant, and the stability of Y defined clas¬ 
sically is equivalent to the stability of My under any sensible assumption 
about uniform continuity (for example, it is so for a compact phase space). 

For systems which relax to a stable equilibrium, the maximal attractor is 
simply one and the same for any bounded positively invariant subset, and it 
consists of a single stable point. 

It is important to note that in the definition (4.1) one considers motions 
of a positively invariant subset to equilibrium along itself : T t Y C Y for t > 0. 
It is precisely this motion which is uninteresting from the perspective of the 
comparison of stability of positively invariant subsets. If one subtracts this 
motion along itself out of the vector field J(x) (3.1), one obtains a less trivial 
picture. 

We again assume submanifolds in U parameterized with a single parame¬ 
ter set F : W —> U . Note that there exists a wide class of transformations 
which do not alter the geometric picture of motion: For a smooth diffeomor- 
phism ip : W —► W (a smooth coordinate transform), maps F and F o p 
define the same geometric pattern in the phase space. 

Let us consider motions of the manifold F(W) along solutions of equation 

(3.1) . Denote as F t the time-dependent map, and write equation of motion 
for this map: 

= J{Ft{y)) . (4.2) 

Let us now subtract the component of the vector field responsible for the 
motion of the map F t (y) along itself from the right hand side of equation 

(4.2) . In order to do this, we decompose the vector field J{x) in each point 
x = F t (y) as 

J(x) = J\\(x) + jy(x) , (4.3) 

where J\\(x) G T t , y (T t , y = ( D y F t {y){L )). If projectors are well defined, P t , y = 
P(F t (y),T t , y ), then decomposition (4.3) has the form: 

J(x) = P t ,yJ(x) + (1 - Pt,y)J(x) • (4.4) 

Subtracting the component J\\ from the right hand side of equation (4.2), we 
obtain, 

FM = { i_p t y) j my)) . (4.5) 

Note that the geometric pictures of motion corresponding to equations 

(4.2) and (4.5) are identical locally in y and t. Indeed, the infinitesimal shift 
of the manifold W along the vector field is easily computed: 

(DyFtMr'JwiFtiy)) = (D y F t (y))-\P t , y J(F t (y))) . (4.6) 

This defines a smooth change of the coordinate system (assuming all solutions 
exist). In other words, the component J± defines the motion of the manifold 
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in {/, while we can consider (locally) the component J\\ as a component which 
locally defines motions in W (a coordinate transform). 

The positive semi-trajectory of motion (for t > 0) of any submanifold in 
the phase space along the solutions of initial differential equation (3.1) (with¬ 
out subtraction of J\\(x)) is the positively invariant manifold. The closure of 
such semi-trajectory is an invariant subset. The construction of the invari¬ 
ant manifold as a trajectory of an appropriate initial edge may be useful for 
producing invariant exponentially attracting set [173,174]. Very recently, the 
notion of exponential stability of invariants manifold for ODEs was revised 
by splitting motions into tangent and transversal (orthogonal) components 
in [175]. 

We further refer to equation (4.5) as the film extension of the dynamical 
system (3.1). The phase space of the dynamical system (4.5) is the set of 
maps F (films). Fixed points of equation (4.5) are solutions to the invari¬ 
ance equation in the differential form (3.3). These include, in particular, all 
positively invariant manifolds. Stable or asymptotically stable fixed points of 
equation (4.5) are the slow manifolds we are interested in. It is the notion of 
stability associated with the film extension of the dynamics which is relevant 
to our study. In Chap. 9, we consider relaxation methods for constructing 
slow positively invariant manifolds on the basis of the film extension (4.5). 


4.2 Stability of Analytical Solutions 

When studying the Cauchy problem for equation (4.5), one should ask a 
question of how to choose the boundary conditions the function F must 
satisfy at the boundary of W. Without fixing the boundary conditions, the 
general solution of the Cauchy problem for the film extension equations (4.5) 
in the class of smooth functions on W is essentially ambiguous. 

The boundary of W, dW, splits in two pieces: dW = dW+ (J dW-. For a 
smooth boundary these parts can be defined as 

dW+ = {ye dWMv), C DF{y))-\P y J{F{y )))) < 0} , 

3W_ = {ye dWMy), (j DF{y))-\P y J{F{y )))) > 0} . (4.7) 

where u(y) denotes the unit outer normal vector at the boundary point y , and 
(. DF(y)) _1 is the isomorphism of the tangent space T y on the linear space of 
parameters L. 

One can understand the boundary splitting (4.7) in such a way: The 
projected vector field P y J(F(y )) defines dynamics on the manifold F(W ), this 
dynamics is the image of some dynamics on W. The corresponding vector field 
on W is v(y) = ( DF(y))~ 1 (P y J(F(y ))). The boundary part dW+ consists of 
points y, where the velocity vector v(y) points inside W, while for y E dW- 
this vector v(y) is directed outside of W (or is tangent to dW). The splitting 
dW = dW+ (J dW- depends on t with the vector field v(y): 
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v t (y) = ( DF t {y))-\P v J{F t {y ))) , 

and the dynamics of F t (y) is determined by (4.5). 

If we would like to derive a solution of the film extension (4.5) F(y , t) 
for (y,t) G W x [0 ,t] for some time r > 0, then it is necessary to fix some 
boundary conditions on dW+ (for the “incoming from abroad” part of the 
function F(y)). 

Nevertheless, there is a way to study equation (4.5) in W without intro¬ 
ducing any boundary condition. It is in the spirit of the classical Cauchy- 
Kovalevskaya theorem [176-178] about analytical Cauchy problem solutions 
with analytical data, as well as in the spirit of the classical Lyapunov auxil¬ 
iary theorem about analytical invariant manifolds in the neighborhood of a 
fixed point [3,52] and the Poincare theorem [50] about analytical linearization 
of analytical non-resonant contractions (see [181]). 

We note in passing that recently the interest to the classical analytical 
Cauchy problem is revived in the mathematical physics literature [179,180]. In 
particular, analogs of the Cauchy-Kovalevskaya theorem were obtained for the 
generalized Euler equations [179]. A technique to estimate the convergence 
radii of the series emerging therein was also developed. 

Analytical solutions to equation (4.5) do not require boundary condi¬ 
tions on the boundary of W. The analyticity condition itself allows finding 
unique analytical solutions of the equation (4.5) with the analytical right 
hand side (1 — P)J for analytical initial conditions Fq in W (assuming that 
such solutions exist). Of course, the analytical continuation without addi¬ 
tional regularity conditions is an ill-posed problem. However, it may be useful 
to switch from functions to germs 1 : we can solve chains of ordinary differen¬ 
tial equations for Taylor coefficients instead of partial differential equations 
for functions (4.5), and it may be possible to prove the convergence of the 
Taylor series thus obtained. This is the way to prove the Lyapunov auxiliary 
theorem [3], and one of the known ways to prove the Cauchy-Kovalevskaya 
theorem. 

Let us consider the system (3.1) with stable equilibrium point x*, real 
analytical right hand side J, and real analytical projector field P(x, T): E —> 
T. We shall study real analytical sub-manifolds, which include the equilibrium 
point point x* (0 G W, F( 0) = x*). Let us expand F in a Taylor series in the 
neighborhood of zero: 


F(y) = x*+A 1 (y) + A 2 (y,y) + ... + A k (y,y,...,y) + ... , (4.8) 

where Ak(y, y ,... ,y) is a symmetric ^-linear operator (k = 1,2 ,...). 

Let us expand also the right hand side of the film equation (4.5). Match¬ 
ing operators of the same order, we obtain a hierarchy of equations for 
Ai,..., A*;,...: 


1 The germ is the sequences of Taylor coefficients that represent an analytical 
function near a given point. 
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^=V k (A 1 ,...,A k ) . (4.9) 

It is crucially important, that the dynamics of A& does not depend on 
1 ,..and equations (4.9) can be studied in the following order: we first 
study the dynamics of A i, then the dynamics of A 2 with the Ai motion 
already given, then A3 and so on. 

Let the projector P y in equation (4.5) be an analytical function of the 
derivative D y F(y) and of the deviation x — x*. Let the corresponding Taylor 
series expansion at the point (A? (•),£*) have the form: 

00 

D y F(y )(•) = ^i(«) + ^kA k (y,...,») , (4.10) 

k =2 

00 

Py= E PkAD v F{y){*)-Al{.),...,D v F{y){.)-A\{.\- 

k,m =0 ^ ^ 

k 

F(y)-x*,...,F(y)-x*) , 

' -v-' 

rri 

where ^°(*), Ai(*), A k (y,..., •) are linear operators. Pk,m is a k + ra-linear 
operator (&, m = 0,1, 2,...) with values in the space of linear operators E —> 
E. The operators Pk,m depend on the operator A^(») as on a parameter. Let 
the point of expansion A^(») be the linear part of F : Aj(») = Ai(»). 

Let us represent the analytical vector field J(x) as a power series: 

00 

J(x ) = ^ Jk{x — rr*,..., x — x*) , (4.11) 

k=l 


where is a symmetric ^-linear operator (fc = 1, 2 ,...). 

Let us write, for example, the first two equations of the equation chain 
(4.9): 

^M=(l-P 0fi )J 1 (A 1 (y)), 

dA2 ^'~ = (1 - Po,o)[MMv,v)) + J 2 (A 1 (y),A 1 (y))} 

— [2Pi,o{A2{y, 9 )) + Po,i{Ai(y))\Ji(Ai(y)) . (4.12) 

Here, operators Po,o ? •)), Po,i(Ai(y)) parametrically depend on 

the operator Ai(»); hence, the first equation is nonlinear, and the second is 
linear with respect to A 2 (y,y). The leading term in the right hand side has 
the same form for all equations of the sequence (4.9): 


dA n (y,...,y) 
d t 


(4.13) 


= (1 - Po,o)Ji{A n (y,... ,y)) - nP li0 (A n (y ,..., y, •)) J^A^y)) + ... 


n —1 
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There are two important conditions on P y and D y F(y ): Py = P y , because 
P y is a projector, and im P y = im D y F(y), because P y projects on the image 
of D y F(y). If we expand these conditions in the power series, then we get the 
conditions on the coefficients. For example, from the first condition we get: 

PS,o = ^0,0 , 

Po,o[2Pi,o(A 2 ( 2 /, •)) + PoAA^y))} + [2Pi )0 (^.2(2/j •)) + Pop(^iG/))]^o,o 
= 2 Pi, 0 (A 2 (2/, •)) + PoAA^y )),.... (4.14) 

After multiplication of the second equation in (4.14) with Pq,o we get 

Po,o[ 2p iAMy, •)) + PoAMy))]Po,o = o. ( 4 . 15 ) 

Similar identities can be obtained for any oder of the expansion. These equal¬ 
ities allow us to simplify the stationary equation for the sequence (4.9). For 
example, for the first two equations of the sequence (4.12) we obtain the 
following stationary equations: 


(1 — Po,o)Ji(Ai(y)) — 0 , 

(1 - Po,o)[Ji(A 2 (y,y)) + J 2 (A 1 (y), A^y))] 

-[2Pi,o (A 2 (y, •)) + PoAAi(y))} JM^y)) = 0 . (4.16) 

The operator Po,o is the projector on the space imAi (the image of Ai), 
hence, from the first equation in (4.16) it follows: Ji(imAi) C imAi. So, 
imAi is a Ji-invariant subspace in E (Ji = D x J(x)\ x *) and Po,o(«^i(^i(2/)) = 
Ji(Ai(y). It is equivalent to the first equation of (4.16). Let us multiply the 
second equation of (4.16) with Pq 5 o from the left. As a result we obtain the 
condition: 


PoA*PMMy,*)) + PoAMy))]Ji(My)) = o, 

for solution of equations (4.16), because Po,o(l — Po,o) = 0- If A\{y) is a so¬ 
lution of the first equation of (4.16), then this condition becomes an identity, 
and we can write the second equation of (4.16) in the form 

(1 - Po,o)[Ji(A 2 (j/,2/)) + J 2 (A 1 (y),A 1 (y)) - (2P 1 , 0 (A 2 (t / , •)) 
+Po,i(A 1 (y)))J 1 (A 1 (y))]=0. (4.17) 

It should be stressed, that the choice of the projector field P y (4.10) has 
impact only on the F(y) parametrization, whereas the invariant geometrical 
properties of the solutions of (4.5) do not depend on the projector field if some 
transversality and analyticity conditions hold. The conditions of thermody¬ 
namic structures preservation significantly reduce ambiguity of the projector 
choice. One of the most important condition is ker P y C kerP^P, where 
x = F(y) and S is the entropy (see Chap. 5 about the entropy below). The 
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thermodynamic projector is the unique operator which transforms the arbi¬ 
trary vector field equipped with the given Lyapunov function into a vector 
field with the same Lyapunov function on the arbitrary submanifold which 
is not tangent to the level of the Lyapunov function. For the thermodynamic 
projectors P y the entropy S(F(y)) is conserved on the solutions F(y, t ) of the 
equation (4.5) for any y eW. 

If the projectors P y in equations (4.10)-(4.17) are thermodynamic, then 
P 0 ,o is the orthogonal projector with respect to the entropic scalar product 2 . 
For orthogonal projectors the operator P^o has a simple explicit form. Let 
A : L —> E be an isomorphic injection (an isomorphism on the image), and 
P : E —> E be the orthogonal projector on the image of A. The orthogonal 
projector on the image of the perturbed operator A + SA is P + 5P, 

SP = (1 - P)5AA~ 1 P + (5AA~ l P ) + {I - P) + o(5A), 
Pi, 0 (<L4(.)) = (1 - P)SA(»)A~ 1 P + (M(.)A“ 1 P)+(1 - P) . (4.18) 

In (4.18), the operator A~ x is defined on iin.4, iin.4 = im P, and the operator 
A _1 P acts on E. 

Equation (4.18) for 5P follows from the three conditions: 

(. P+6P)(A+6A ) = A+SA, ( P+6P) 2 = P+SP, ( P+6P) + = P+6P . (4.19) 

Every Ak is driven by Ai,... ,Ak~ i- Stability of the germ of the posi¬ 
tively invariant analytical manifold F{W ) at point 0 (P(0) = x*) is defined 
as stability of the solution of the corresponding equations sequence (4.9). 
Moreover, the notion of the /c-jet stability can be useful: let us call k- jet 
stable such a germ of a positively invariant manifold F(M) at the point 0 
(P(0) = x*), if the corresponding solution of the equation sequence (4.9) is 
stable for k = 1,..., n. The simple “triangle” structure of the equation se¬ 
quence (4.9) with the form (4.13) of principal linear part makes the problem 
of jets stability very similar for all orders n > 1. 

Let us demonstrate the stability conditions for the 1-jets in a n-dimensio- 
nal space E. Let the Jacobian matrix J\ = D x J(x)\ x * be selfadjoint with 

a simple spectrum A*,_, A n , and the projector Pq 5 o be orthogonal (this is 

a typical “thermodynamic” situation). The eigenvectors of J\ form a basis 
in E : {ei}^ =1 . Let a linear space of parameters L be the ^-dimensional real 
space, k < n. We shall study the stability of operator A\ which is a fixed 
point for the first equation of the sequence (4.9). The operator A\ is a fixed 
point of this equation, if im A\ is a J\ -invariant subspace in E. We discuss 
full-rank operators, so, for some order of numbering, the matrix of 

A\ should have a form: oA u - = 0, if i > k. Let us choose the basis in L: 
lj = (A\)~ 1 ej, (j = 1,..., k). For this basis a^ - = 5^-, (i = 1,... ,n, j = 


2 This scalar product is the bilinear form defined by the negative second differential 
of the entropy at the point x*, —D 2 S(x). 
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1 where Sij is the Kronecker symbol). The corresponding projectors 

P and 1 — P have the matrices: 


P = diag(l,..., 1,0,... ,0), 1 — P = diag(0,• ••, 0,1,..., 1) , (4.20) 


n—k 


n—k 


where diag(aq,..., a n ) is the n x n diagonal matrix with numbers aq,..., a n 
on the diagonal. 

The equations of the linear approximation for the dynamics of the varia¬ 
tion 5A read: 

= diag(0 ,. „ , 0 , 1, ■ „, 1 ) [diag(Aj,..., A n )SA - <L4diag( Ai,..., A k ) ] . 

k n—k k 

(4.21) 

The time derivative of A is orthogonal to A: for any y, z G L the equality 
{A{y),A{x)) = 0 holds, hence, for the stability analysis it is necessary and 
sufficient to study 5A with ink)^ _L imA The matrix for such a 5A has the 
form: 

5a,ij =0, if i < k . 

For i = k + 1,..., n, j = 1,..., k equation (4.21) gives: 

< ‘^ ii - (A; A/Mr,,-, . (4.22) 

Therefore, the stability condition becomes: 

A i — Xj < 0 for all i > k, j < k . (4.23) 

This means that the relaxation towards imA (with the spectrum of relaxation 
times |Ai| _1 (i = k + 1 ,..., n)) is faster, than the relaxation along imA (with 
the spectrum of relaxation times |Aj| -1 (j = 1 ,..., k)). 

Let the condition (4.23) hold. For negative A, it means that the relaxation 
time for the film (in the first approximation) is: 

r = l/(min|Aj| -maxlAjI) , 

i>k j<k 

thus it depends on the spectral gap in the spectrum of the operator J\ = 

D X J{pc) I#* • 

It is the gap between spectra of two restrictions of the operator J \, jf and 
J-j 1 , respectively. The operator j\ is the restriction of J\ on the Ji-invariant 
subspace imA^ (it is the tangent space to the slow invariant manifold at point 
x *). The operator J(- is the restriction of J\ on the orthogonal complement to 
irm45- This subspace is also Ji-invariant, because J\ is selfadjoint. The spec¬ 
tral gap between spectra of these two operators is the spectral gap between 
relaxation towards the slow manifold and relaxation along this manifold. 
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The stability condition (4.23) demonstrates that our formalization of the 
slowness of manifolds as the stability of fixed points for the film extension 
(4.5) of initial dynamics meets the intuitive expectations. 

For the analysis of system (4.9) in the neighborhood of some manifold 
Fq (Fq(0) = x*), the following parametrization can be convenient. Let us 
consider 

F 0 (y)=A 1 (y) + ..., T 0 = A X {L) 

to be a tangent space to Fq(W) at point x*, E = Tq ® H is the direct sum 
decomposition. 

We shall consider analytical sub-manifolds in the form 

x = x* + (y,$(y)) , (4.24) 

where y G Wo C Tq, Wo is a neighborhood of zero in Tq, @(y) is an analytical 
map of Wo in if, and ^>(0) = 0. Any analytical manifold close to Fq can be 
represented in this form. 

Let us define the projector P y that corresponds to the decomposition 
(4.24), as the projector on T y parallel to H. Furthermore, let us introduce the 
corresponding decomposition of the vector field J = J y (&J z ,Jy G Tq, J z G H. 
Then 

Py(j) = ( Jy , (Dy0(y))Jy) . (4.25) 

The corresponding equation of motion of the film (4.5) has the following 
form: 

= UyMv)) ~ {Dy${y))Jy{y,$(y)) . (4.26) 

If J y and J z depend analytically on their arguments, then from (4.26) 
one can easily obtain a hierarchy of equations of the form (4.9) (of course, 
Jy(z*)= 0, J Z (X*) = 0). 

Using these notions, it is convenient to formulate the Lyapunov auxiliary 
theorem [3]. Let To = i7 m ,iL = R p , and in V an analytical vector field be 
defined J(y,z) = J y (y,z) 0 J z (y,z ), (y G To,z G H). Assume the following 
conditions are satisfied: 

1 . J(0,0) = 0; 

2. D z J y (y,z) |( QQ ) = 0; 

3. 0 ^ conv{fci,..., k m }, 

where fcj_,..., k m are the eigenvalues of the operator D y J y (y , z)|^ 0 , and 

conv{/ci,..., k m } is the convex hull of {£q,..., fc m }; 

4. the numbers and A j are not related by any equation of the form 

m 

0 rriiki = Xj , (4.27) 

where Xj (j = 1 ...., p) are eigenvalues of D z J z (y, z) | (() 0j . and m t > 0 are 
integers, YT=i m i > 
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Let us also consider an analytical manifold (y, @(y)) in V in the neighborhood 
of zero (<Z>(0) = 0) and write for it the differential invariance equation with 
the projector (4.25): 


(D v 4>(y))J y (y,<I>(y)) = J z (y,${y)) . (4.28) 

Lyapunov auxiliary theorem. Given conditions 1-4, equation (4.24) 
has the unique analytical solution in the neighborhood of zero, satisfying the 
condition #(0) = 0. 

Recently, various new applications of this theorem were developed [52, 
184-186]. 

In order to weaken the non-resonance condition in [49] the existence of 
invariant manifolds near fixed points tangent to invariant subspaces of the 
linearization was proved without assumption that the corresponding space 
for the linear map is a spectral subspace. (This proof was based on the graph 
transform method [46].) 

Studying germs of invariant manifolds using Taylor series expansion in 
a neighborhood of a fixed point is definitely useful from the theoretical as 
well as from the practical perspective. But the well known difficulties perti¬ 
nent to this approach, of convergence, of small denominators (connected with 
proximity to the resonances (4.27)) and others call for development of differ¬ 
ent methods. A hint can be found in the famous KAM theory: one should 
use iterative methods instead of the Taylor series expansion [4-6]. Below we 
present two such methods: 

- The Newton method subject to incomplete linearization; 

- The relaxation method which is the Galerkin-type approximation to New¬ 
ton’s method with projection on the defect of invariance (3.3), i.e. on the 
right hand side of equation (4.5). 


5 Entropy, Quasiequilibrium, 
and Projectors Field 


Projection operators P y contribute both to the invariance equation (3.2), and 
to the film extension of the dynamics (4.5). Limiting results, exact solutions, 
etc. only weakly depend on the particular choice of projectors, or do not 
depend on it at all. However, validity of approximations obtained on each 
iteration step towards the limit strongly depends on the choice of the pro¬ 
jector. Moreover, if we want each approximate solution to be consistent with 
such physically crucial conditions as the second law of thermodynamics (the 
entropy of the isolated systems increases), then the choice of the projector 
becomes practically unique. 

In this chapter we consider the main ingredients for constructing the 
projector, based on the two additional structures: 

(a) The moment parameterization, 

(b) The entropy and the entropic scalar product. 

5.1 Moment Parameterization 

Same as in the previous chapters, let a regular map (projection) is defined, 
II : U —> W. We consider only maps F : W —> U which satisfy 77 oF = 1. We 
seek slow invariant manifolds among such maps. (A remark is in order here: 
sometimes one has to consider F which are defined not on the whole W but 
only on some subset of it.) In this case, the unique projector consistent with 
the given structure is the superposition of the differentials (the chain rule): 


Py — (PyP)y ° • 


(5.1) 


In the language of differential equations (5.1) has the following significance: 
First, equation (3.1) is projected, 


^ = (. D x n) F{y) J{F{y )) . 


(5.2) 


Second, the latter equation is lifted back to U with the help of F and its 
differential, 


Alexander N. Gorban and Iliya V. Karlin: Invariant Manifolds for Physical and Chemical 
Kinetics , Lect. Notes Phys. 660, 79-138 (2005) 
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x(t) = F{y{t)) ; 


(5.3) 


dx 

dt x=F(y ) 


(DyF)y = (D y F) y {(D x n) ny) J(F{ V ))) = P y J(F(y )) . 


The most standard example of the construction just described is as follows: 
x is the distribution density, y = II(x) is the set of selected moments of this 
density, F : y —> x is a “closure assumption”, a distribution density parame¬ 
terized by the values of the moments y. Another standard example is relevant 
to problems of chemical kinetics: x is a detailed description of the reacting 
mixture (including all intermediates and radicals), y are concentrations of 
stable reactants and products of the reaction. 

The moment parameterization and moment projectors (5.1) are often en¬ 
countered in applications. However, they have certain shortcomings. In partic¬ 
ular, it is by far not always the case that the moment projection transforms 
a dissipative system into another dissipative system. Of course, for invari¬ 
ant F(y) any projector transforms the dissipative system into a dissipative 
system. However, for various approximations to invariant manifolds (closure 
assumptions) this is not readilyso 1 . The property of projectors to preserve 
the type of the dynamics will be imposed below as one of the requirements. 

5.2 Entropy and Quasiequilibrium 

The dissipation properties of the system (3.1) are described by specifying 
the entropy 5, the distinguished Lyapunov function which monotonically 
increases along solutions of equation (3.1). In a certain sense, this Lyapunov 
function is more fundamental than the system (3.1) itself. That is, usually, the 
entropy is known much better than the right hand side of equation (3.1). For 
example, in chemical kinetics, the entropy is obtained from the equilibrium 
data. The same holds for other Lyapunov functions, which are defined by 
the entropy and by a specification of the reaction conditions (the free energy, 
U — TS, for the isothermal isochoric processes, the free enthalpy, U — TH, 
for the isothermal isobaric processes etc.). On physical grounds, all these 
entropic Lyapunov functions are proportional (up to additive constants) to 
the entropy of the minimal isolated system which includes the system under 
study [115]. In general, with some abuse of language, we term the Lyapunov 
functional S the entropy elsewhere below, although it may be a different 
functional for non-isolated systems. 

Thus, we assume that a concave functional S is defined in [/, such that it 
takes maximum in an inner point x* G U. This point is termed the equilib¬ 
rium. 


1 See, e.g. a discussion of this problem for the Tamm-Mott-Smith approximation 
for the strong shock wave in [9]. 
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For any dissipative system (3.1) under consideration in 17, the derivative 
of S due to equation (3.1) must be nonnegative, 

^ = (. D x S)(J(x )) > 0 , (5.4) 

where D X S is the linear functional, the differential of the entropy, while the 
equality in (5.4) is attained only in the equilibrium x = x*. 

Most of the works on nonequilibrium thermodynamics deal with quasi- 
equilibrium approximations and corrections to them, or with applications of 
these approximations (with or without corrections). This viewpoint is not 
the only possible but it proves very efficient for the construction of a vari¬ 
ety of useful models, approximations and equations, as well as methods to 
solve them. From time to time it is discussed in the literature, who was the 
first to introduce the quasiequilibrium approximations, and how to interpret 
them. At least a part of the discussion is due to a different role the qua¬ 
siequilibrium plays in the entropy-conserving and the dissipative dynamics. 
The very first use of the entropy maximization dates back to the classical 
work of G. W. Gibbs [222], but it was first claimed for a principle of in¬ 
formational statistical thermodynamics by E. T. Jaynes [193]. Probably the 
first explicit and systematic use of quasiequilibria to derive dissipation from 
entropy-conserving systems was undertaken by D. N. Zubarev. Recent de¬ 
tailed exposition is given in [195]. For dissipative systems, the use of the 
quasiequilibrium to reduce description can be traced to the works of H. Grad 
on the Boltzmann equation [201]. A review of the informational statistical 
thermodynamics was presented in [227]. The connection between entropy 
maximization and (nonlinear) Onsager relations was also studied [164,188]. 
The viewpoint of the present authors was influenced by the papers by L. I. Ro- 
zonoer and co-workers, in particular, [223-225]. A detailed exposition of the 
quasiequilibrium approximation for Markov chains is given in the book [115] 
(Chap. 3, Quasiequilibrium and entropy maximum , pp. 92-122), and for the 
BBGKY hierarchy in the paper [226]. The maximum entropy principle was 
applied to the description the universal dependence the three-particle distri¬ 
bution function F 3 on the two-particle distribution function F 2 in classical 
systems with binary interactions [229]. For a discussion the quasiequilibrium 
moment closure hierarchies for the Boltzmann equation [224] see the pa¬ 
pers [230,233,234]. A very general discussion of the maximum entropy prin¬ 
ciple with applications to dissipative kinetics is given in the review [231]. 
Recently the quasiequilibrium approximation with some further correction 
was applied to description of rheology of polymer solutions [254,266] and of 
ferrofluids [267,268]. Quasiequilibrium approximations for quantum systems 
in the Wigner representation [36,37] was discussed very recently [232]. We 
shall now introduce the quasiequilibrium approximation in the most general 
setting. 

A linear moment parameterization is a linear operator, 77 : E —> 7, 
where L = imll = 77/kerTI, kerTI is a closed linear subspace of space E , 
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and 77 is the projection of E onto factor-space L. Let us denote W = 77(17). 
Quasiequilibrium (or restricted equilibrium, or conditional equilibrium, or 
constrained equilibrium) is the embedding, F* : W —> 7/, which puts into 
correspondence to each y G W the solution to the entropy maximization 
problem: 

S(x) — > max, n(x) = y . (5.5) 

We assume that, for each y G intW, there exists the unique solution 
F*(y) G int U to the problem (5.5). This solution, F*(?/), is called the quasi¬ 
equilibrium, corresponding to the value y of the macroscopic variables. The 
set of quasiequilibria F*(y), y G W, forms a manifold in int V, parameterized 
by the values of the macroscopic variables y eW. 

Let us specify some notations: E T is the adjoint to the E space. Adjoint 
spaces and operators will be indicated by T , whereas notation * is earmarked 
for equilibria and quasiequilibria. 

Furthermore, [l,x\ is the result of application of the functional l G E T to 
the vector x G E. We recall that, for an operator A : E± —» F 2 , the adjoint 
operator, A T : E\ —► Ej is defined by the following relation: For any l G E J 
and x g7i, 


[l, Ax] = [A T l,x\ . 

Next, D x S(x ) G E T is the differential of the entropy functional S(x), 
D^S(x) is the second differential of the entropy functional S(x). The cor¬ 
responding quadratic functional D%S(x)(z,z) on E is defined by the Taylor 
formula, 

S(x + z) = S(x) + [D x S(x)i z ] + ^DlS(x)(z, z) + o{\\z\\ 2 ) . (5.6) 

We keep the same notation for the corresponding symmetric bilinear form, 
DxS(x)(z,p), and also for the linear operator, D^S(x) : E —» F T , defined by 
the formula, 


[D 2 x S(x)z,p\ = D 2 S(x)(z,p) . 

In the latter formula, on the left hand side, there is the operator, on the 
right hand side there is the bilinear form. Operator D^S(x) is symmetric on 
E, D 2 S{x) T = DlS(x). 

Concavity of the entropy S means that, for any z G F, the inequality 
holds, 

DlS{x){z,z) < 0 ; 

in the restriction onto the affine subspace parallel to kerTI we assume the 
strict concavity, 


DnS(x)(z, z) < 0, if z G kerTI, and if 2 ^ 0 . 
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In the remainder of this section we are going to construct the important 
object, the projector onto the tangent space of the quasiequilibrium manifold. 

Let us compute the derivative D y F*(y). For this purpose, let us apply 
the method of Lagrange multipliers: There exists such a linear functional 
A(y) G (7) T , that 

D x S(x)\ F , (y) = A(y) • FI, n(F*(y)) = y , (5.7) 

or 

D x S(x)\ F , (y) = II T ■ A(y), n(F*(y )) = y . (5.8) 

From equation (5.8) we get, 

n(D y F*(y)) = 1 L , (5.9) 

where we have indicated the space in which the unit operator acts. Next, using 
the latter expression, we transform the differential of the equation (5.7), 

DyA = (n{D 2 x s)-\ y) n T r l , (5.10) 


and, consequently, 

D y F*(y ) = (DlS)£ (y) n T (n(D 2 x S)rl ly) n T r t . (5.11) 

Notice that, elsewhere in equation (5.11), operator acts on the linear 

functionals from L T . These functionals are precisely those which become 
zero on ker 77 or, that is the same, those which can be represented as linear 
functionals of macroscopic variables. 

The tangent space to the quasiequilibrium manifold at the point F* (y) is 
the image of the operator D y F*(y ): 

im (D y F*(y)) = (. D 2 x S)~l {y) L T = (D 2 x S)~l (y) Ann(ker 17) (5.12) 

where Ann(ker 77) is the set of linear functionals which become zero on ker 77. 
Another way to write equation (5.12) is the following: 

x e im (D y F*(y)) ( D 2 x S) F , {y) {z,p) = 0, p G ker 17 . (5.13) 

This means that im (D y F*(y)) is the orthogonal complement of ker 77 in E 
with respect to the scalar product, 

(z\p)F* (y) = -{D 2 x S) F . (y) {z,p) . (5.14) 

The entropic scalar product (5.14) appears often in the constructions 
below. (Usually, it becomes the scalar product indeed after the conservation 
laws are excluded). Let us denote as T y = im.(D y F*(y)) the tangent space 
to the quasiequilibrium manifold at the point F*{y). Important role in the 
construction of quasiequilibrium dynamics and its generalizations is played by 
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the quasiequilibrium projector, an operator which projects E on T y parallel 
to ker 77. This is the orthogonal projector with respect to the entropic scalar 
product, P* : E —► T y : 

p; = D v F*{y) • n = (z^l^)' 1 n T (n (Dls\ F , {y) )~ l n. 

(5.15) 

It is straightforward to check the equality P* 2 = P*, and the self-adjointness 
of P* with respect to the entropic scalar product (5.14). Thus, we have in¬ 
troduced the basic constructions: the quasiequilibrium manifold, the entropic 
scalar product, and the quasiequilibrium projector. 

Quasiequilibrium entropy S(y ) is a functional on W. It is defined as the 
value of the entropy on the corresponding quasiequilibrium x = F*(y ): 

S(y) = S(F*(y)) (5.16) 

Quasiequilibrium dynamics is a dynamics on W, defined by the equation 
(5.2) for the quasiequilibrium F*(y ): 

^ = IIJ(F*(y)). (5.17) 

Here Ed is constant linear operator (in the general case (5.2), it may be¬ 
come nonlinear). The corresponding quasiequilibrium dynamics on the qua- 
siequilibrium manifold F*(W ) is defined using the projector (5.1): 

dr 

— = P;\ x=F , {y) J(x) = (. D y F*) x=F , iy) nj(x), x e F*(W) . (5.18) 

The orthogonal projector P* in the right hand side of equation (5.18) can 
be explicitly written using the second derivative of S and the operator 77 
(5.15). Let’s remind that the only distinguished scalar product in E is the 
entropic scalar product (5.14): 


(z,p) x = -(DlS) x (z,p) (5.19) 

It depends on the point x G U. This dependence (1)^ endows U with the 
structure of a Riemann space. 

The most important property of the quasiequilibrium system (5.17), (5.18) 
is highlighted by the conservation of the dynamics type theorem: if for the 
original dynamic system (3.1) > 0, then for the quasiequilibrium dynam¬ 

ics > 0. If for the original dynamic system (3.1) ^ = 0 (conservative 
system), then for the quasiequilibrium dynamics = 0 as well. 

The construction of the quasiequilibrium allows for the following gener¬ 
alization: Almost every manifold can be represented as a set of minimizers 
of the entropy under linear constraints. However, in contrast to the standard 
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quasiequilibrium, these linear constraints will depend, generally speaking, on 
the point on the manifold. 

So, let the manifold Q = F(W) C U be given. However, now macroscopic 
variables y are not functionals on R or U but just parameters identifying 
points on the manifold. The problem is how to extend the definitions of y 
onto a neighborhood of F(W ) in such a way that F(W ) will become a solution 
to the variational problem: 

S(x) —» max, II(x) = y . (5.20) 

For each point F(y), we identify T y E E , the tangent space to the manifold 
i? in F y , and the subspace Y y C E, which depends smoothly on y , and which 
has the property, Y y ® T y = E. Let us define II (x) in the neighborhood of 
F(W ) in such a way, that 

H(x) =y, if x - F(y) E Y y . (5-21) 

The point F(y) is the solution of the quasiequilibrium problem (5.20) if 
and only if 

D x S(x)\ F ( y ) e Ann Y y • ( 5 - 22 ) 

That is, if and only if Y y C keiD x S(x)\ F ^y It is always possible to con¬ 
struct subspaces Y y with the properties just specified, at least locally, if the 
functional D X S \ F ^ is n °f identically equal to zero on T y . 

The construction just described allows to consider practically any mani¬ 
fold as a quasiequilibrium. This construction is required when one seeks the 
induced dynamics on a given manifold. Then the vector fields are projected 
on T y parallel to Y y , and this preserves the basic properties of the quasiequi¬ 
librium approximations. 


5.3 Thermodynamic Projector 
without a Priori Parameterization 

Quasiequilibrium manifolds is a place where the entropy and the moment 
parameterization “meet each other”. The projector P y for a quasiequilibrium 
manifold is nothing but the orthogonal with respect to the entropic scalar 
product (\) x projector (5.15). The quasiequilibrium projector preserves the 
type of dynamics. Note that in order to preserve the type of dynamics we 
needed only one condition to be satisfied, 


ker P y C ker {D X S) X=F ^ . (5.23) 

Let us require that the field of projectors, P(x,T), is defined for any x 
and T satisfying the following transversality condition holds 
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Tf£kerD x S. (5.24) 

It follows immediately from the condition (5.23) that in the equilibrium, 
P(x*,T) is the orthogonal projector onto T (ortogonality is with respect to 
the entropic scalar product (|)^*)- 

The field of projectors was constructed in the neighborhood of the equilib¬ 
rium following the requirement of the maximal smoothness of P as a function 
of g x = D X S and x [22]. It turns out that to the first order in the deviations 
x — x* and g x — g x * , the projector is defined uniquely. Let us first describe 
the construction of the projector, and next discuss its uniqueness [10]. 

Let the subspace T C T, the point x, and the differential of the entropy 
at this point, g = D X S , be defined in such a way that the transversality 
condition (5.24) is satisfied. Let us define To = T f]ker g x . By the condition 

(5.24) , To 7 ^ T. Let us denote, e g = e g (T) G T the vector in T, such that 
e g is orthogonal to T 0 , and is normalized by the condition g{e 9 ) = 1. The 
vector e g is defined unambiguously. The projector Ps jX = P(x,T) is defined 
as follows: For any z G E, 

Ps,x( z ) = Po{z) + e g g x (z) , (5.25) 

where Po is the orthogonal projector on To (orthogonality is with respect 
to the entropic scalar product (1)^). The thermodynamic projector (5.25) de¬ 
pends on the point x through the x-dependence of the scalar product (\) x , 
and also through the differential of S in x, the functional g x . Further we shall 
often omit the index S in Ps, x - 

Obviously, P(z) = 0 implies g(z) = 0, that is, the thermodynamicity 
requirement (5.23) is satisfied. Uniqueness of the thermodynamic projector 

(5.25) is supported by the requirement of the maximal smoothness (analytic- 
ity) [22] of the projector as a function of g x and (\) x , and is done in two steps 
which we sketch here (detailed proof is given in the next section, following 
the paper [10]): 

1. Considering the expansion of the entropy at the equilibrium up to the 
quadratic terms, one demonstrates that in the equilibrium the thermo¬ 
dynamic projector is the orthogonal projector with respect to the scalar 
product (\) x *. 

2. For a given g, one considers auxiliary dissipative dynamic systems (3.1), 
which satisfy the condition: For every x' G J7, it holds, g x (J(x')) = 0, 
that is, g x defines an additional linear conservation law for the auxiliary 
systems. For the auxiliary systems, the point x is the equilibrium. Elimi¬ 
nating the linear conservation law g x , and using the result of the previous 
point, we end up with the formula (5.25). 

Thus, the entropic structure defines unambiguously the field of projectors 

(5.25) , for which the dynamics of any dissipative system (3.1) projected on 
any closure manifold remains dissipative. 
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5.4 Uniqueness of Thermodynamic Projector 

In this section, the uniqueness theorem for thermodynamic projector will be 
proved. 


5.4.1 Projection of Linear Vector Field 

Let E be real Hilbert space with the scalar product ( |), Q be a set of linear 
bounded operators in E with negatively definite quadratic form (Ax \ x) < 0 
for every T^Pbea nontrivial (T ^ {0}) closed subspace. For every 

projector P : E —> T (P 2 = P) and linear operator A : E E we define the 
projected operator P(A) : T —> T in such a way: 

P(A)x = PAx = PAPx for x G T . (5.26) 

The space T is the Hilbert space with the scalar product ( | ). Let Qt be a 
set of linear bounded operators in T with negatively definite quadratic form 

(Ax | x) < 0. 

Proposition 1. The inclusion P(Q) C Q T for a projector P : E —> T holds 
if and only if P is the orthogonal projector with respect to the scalar product 

(D- 

Proof. If P is orthogonal (and, hence, selfadjoint) and (Ax \ x) <0, then 
(PAPx | x) = (APx | Px) < 0 . 

If P is not orthogonal, then Px ^ 0 for some vector x G T 1 - in orthogonal 
complement of T. Let us consider the negatively definite selfadjoint operator 

A x = — | Px — ax) (Px — ax \ 

(. A x y = — (Px — ax)(Px — ax \ y)). The projection of A x on T is: 

P(A x ) = (a-l) \Px)(Px\ . 

This operator is not negatively definite for a > 1. □ 

Immediately from this proof follows the Corollary 1. 

Corollary 1. Let Q sym C Q be a subset of selfadjoint operators in E. The 
inclusion P(Q sym ) C Q T for a projector P : E —> T holds if and only if P is 
the orthogonal projector with respect to the scalar product ( \ ). □ 

Corollary 2. Let Q^ m C Qt be a subset of selfadjoint operators in T . If 
P(Q ) C Qt for a projector P : E —> T, then P(Q sym ) C 
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It follows from the Proposition 1 and the obvious remark: If operators A 
and P are selfadjoint, then operator PAP is selfadjoint too. 

The Proposition 1 means that a projector which transforms every linear 
vector field Ax with Lyapunov function (x \ x) into projected vector field 
PAPx with the same Lyapunov function is orthogonal with respect to the 
scalar product ( | ). 

According to the Corollary 1, the conditions of the Proposition 1 can 
be made weaker: A projector which transforms every selfadjoint linear vector 
field Ax with Lyapunov function (x \ x) into projected vector field PAPx with 
the same Lyapunov function is orthogonal with respect to the scalar product 
( | ). In physical applications it means, that we can deal with requirement of 
dissipation persistence for vector field with Onsager’s reciprocity relations. 
The consequence of such a requirement will be the same, as for the class of 
all continuous linear vector field: The projector should be orthogonal. 

The Corollary 2 is a statement about persistence of the reciprocity rela¬ 
tions. 


5.4.2 The Uniqueness Theorem 

In this subsection we discuss finite-dimensional systems. There are techni¬ 
cal details which make the theory of nonlinear infinite-dimensional case too 
cumbersome: the Hilbert spaces equipped with entropic scalar product ( | ) x 
(5.14) for different x consist of different functions. Of course, there exists a 
common dense subspace, and geometrical sense remains the same, as for the 
finite-dimensional space, but we defer the discussion of all the details till a 
special mathematical publication. 

Let E be n-dimensional real vector space, U C E be a domain in E, and 
a m-dimensional space of parameters L be defined, m < n, and let IT be a 
domain in L. We consider differentiable maps, F : IT —> C7, such that, for 
every y G IT, the differential of F, D y F : L —> E, is an isomorphism of L on 
a subspace of E. That is, F are the manifolds, immersed in the phase space 
of the dynamic system (3.1), and parametrized by parameter set IT. 

Let the twice differentiable function S on U be given (the entropy). We 
assume that S is strictly concave in the second approximation: The quadratic 
form defined by second differential of the entropy D%S(y,y) is strictly neg¬ 
ative definite in E for every x G U. We will use the entropic scalar product 
(13.2). Let S have the interior point of maximum in U : x eq G inti/. 

The function S is Lyapunov function for a vector field J in I/, if 

(. D x S)(J(x )) > 0 for every x G U . 

First of all, we shall study vector fields with Lyapunov function S in 
the neighborhood of x eq . Let 0 G intIT, F : IT —► U be an immersion, 
and F(0) = x eq . Let us define T y = im D y F(y) for each y G IT. This T y is 
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the tangent space to F(W ) in the point y. Assume that the mapping F is 
sufficiently smooth, and F(W) is not tangent to entropy levels: 

T y ker D x S\ x=F{y) 

for every y 0. The thermodynamic projector for a given F is a projector¬ 
valued function y i—> P y , where P y : E —■> T y is a projector. The thermody¬ 
namic conditions reads: For every smooth vector field J(x) in U with Lya¬ 
punov function S the projected vector field P y (J(F(y ))) on F(W ) has the 
same Lyapunov function S(F(y)). 

Proposition 1 and Corollaries 1, 2 make it possible to prove uniqueness 
of the thermodynamic projector for the weakened thermodynamic conditions 
too: For every smooth vector field J(x) in U with Lyapunov function S and 
self adjoint Jacobian operator for every equilibrium point (zero of J(x)) the 
projected vector field P y (J(F(y ))) on F(W) has the same Lyapunov function 
S(F(y)). We shall not discuss it separately. 

Proposition 2. Let the thermodynamic projector P y be a smooth function 
ofy. Then 

Po = P(t and Py = Py + 0(y) , (5.27) 

where is orthogonal projector onto T y with respect to the entropic scalar 
product (| ) F ( V )- 

Proof. A smooth vector field in the neighborhood of F(0) = x eq can be 
presented as A(x — x eq ) + o(\\x — £ eq ||), where A is a linear operator. If 
S is the Lyapunov function for this vector field, then the quadratic form 
(Ax | x) x ed is negatively definite. P y = Po + O(y), because P y is a continuous 
function. Hence, for Po we have the problem solved by the Proposition 1, and 
P 0 = P 0 ± . □ 

Theorem 1. Let the thermodynamic projector P y be a smooth function ofy. 
Then 

Py — P()y F 6gD x S\ x —F(y) 5 (5.28) 

where notations of formula (13.4) are used: Tq v is the kernel of linear func¬ 
tional D x S\ x= f( v ) in T y , Po y : Tq v —> E is the orthogonal projector with 
respect to the entropic scalar product (\ )F{y) (5-lf). Vector e g G T is propor¬ 
tional to the Riesz representation g y of linear functional D x S\ x= f ( v ) in T y 
with respect to the entropic scalar product: 

(dy I x )F(y) = ( D x S\ x= F( y ))(x ) 

for every x G T y , e g = g y /{g y \ 9 y )F ( y )• 

Proof. Let y 0. Let us consider an auxiliary class of vector fields J on U 
with additional linear balance (D x S) x= F( y ))(J) = 0- If such a vector field has 
Lyapunov function 5, then x = F(y) is its equilibrium point: J(F(y)) = 0. 
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The class of vector fields with this additional linear balance and Lyapunov 
function S is sufficiently rich and we can use the Propositions 1, 2 for dy¬ 
namics on the auxiliary phase space 

{z€U\(D x S\ x=F(v) )(z-F(y)) = 0}. 

Hence, the restriction of P y on the hyperplane ker D x S\ x= p{ y ) is Po y . Formula 
(5.28) gives the unique continuation of this projector on the whole E. □ 

5.4.3 Orthogonality of the Thermodynamic Projector 
and Entropic Gradient Models 

In Euclidean spaces with the given scalar product, we often identify the dif¬ 
ferential of a function f(x) with its gradient: in the orthogonal coordinate 
system (grad/(x))^ = df(x)/dxi. However, when dealing with a more general 
setting, one can run into problems while making sense out of such a defini¬ 
tion. What to do, if there is no distinguished scalar product, no preselected 
orthogonality? 

For a given scalar product ( | ) the gradient grad cc /(x) of a function f(x) 
at a point x is such a vector g that (g\y) = D x f(y) for any vector y, where 
D x f is the differential of function / at a point x. The differential of function 
/ is the linear functional that provides the best linear approximation near 
the given point. 

In order to transform a vector into a linear functional one needs a pair¬ 
ing , that means a bilinear form ( | ). This pairing transforms vector g into 
linear functional (g |: (g\(x) = (g\x). Any twice differentiable function f(x) 
generates a field of pairings: at any point x there exists a second differential 
of /, a quadratic form (D%f)(Ax, Ax). For a convex function these forms are 
positively definite, and we return to the concept of scalar product. Let us cal¬ 
culate a gradient of / using this scalar product. In coordinate representation 
the identity (grad/(x) | y) x = ( D x f)(y ) (for any vector y) has a form 

■ (5 - 29) 

i,j J i J 

hence, 

(grad/(a;))* = Jy; • ( 5 - 30 ) 

3 3 

As we can see, this grad f(x) is the Newtonian direction , and with this gra¬ 
dient the method of steepest descent transforms into the Newton method of 
optimization. 

Entropy is the concave function and we defined the entropic scalar prod¬ 
uct through negative second differential of entropy (13.2). Let us define the 
gradient of entropy by means of this scalar product: (grad^, S\z) x = ( D x S)(z ). 
The entropic gradient system is 
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— = tp(x)gv&d x S , (5.31) 

where p(x) > 0 is a positive kinetic multiplier. 

The system (5.31) is a representative of a family of model kinetic equa¬ 
tions. One replaces complicated kinetic equations by model equations for 
simplicity. The main requirements to such models are: they should be as 
simple as possible and should not violate the basic physical laws. The most 
known model equation is the BGK model [116] for the collision integral in 
the Boltzmann equation. There are different models for simplifying kinet¬ 
ics [117,118]- The entropic gradient models (5.31) possesses all the required 
properties (if the entropy Hessian is sufficiently simple). It was invented for 
the lattice Boltzmann kinetics [166]. In many cases it is simpler than the BGK 
model, because the gradient model is local in the sense that it uses only the 
entropy function and its derivatives at a current state, and it is not necessary 
to compute the equilibrium (or quasiequilibrium for quasiequilibrium models 
2.92 [22,117]). The entropic gradient model has a one-point relaxation spec¬ 
trum, because near the equilibrium x eq the gradient vector field (5.31) has 
an extremely simple linear approximation: d(Ax)/ d t = — (p(x eq )Ax. It corre¬ 
sponds to a well-known fact that the Newton method minimizes a positively 
defined quadratic form in one step. 

A direct computation shows that the thermodynamic projector P (13.4) 
in a point x onto the tangent space T can be rewritten as 


p(j) = p ± (j) + 


grades'll 

(grades'll |gradesH )aj 


(grades'- 1 1 J) x , 


(5.32) 


where P 1 - is the orthogonal projector onto T with respect the entropic scalar 
product, and the gradient grades' is splitted onto tangent and orthogonal 
components: 

grades' = grades'" + grades' -1 : 

grad^l = P 1 - grad^; grad X S ± = (1 — P^) grades' . 

From (5.32) it follows that the two properties of an ansatz manifolds are 
equivalent: orthogonality of the thermodynamic projector and invariance of 
the manifold with respect to the entropic gradient system (5.31). 


Proposition 3. The thermodynamic projector for an ansatz manifold Q is 
orthogonal at any point x £ f2 if and only if grades' G T x (fi) at any point 
x G 17. □ 


It should be possible to think of gradients as infinitesimal displacements 
of points x. Usually there are some balances, at least the conservation of the 
total probability, and the gradient should belong to a given subspace of zero 
balances change. For example, for the classical Boltzmann-Gibbs-Shannon 
entropy (x = \P(q)), S = — f T(q)(lnT(q) — 1) dg, the entropic scalar product 
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is (g(q)\f(q))* = J g{q)f{q)/^{q)dq, and grades' = -&(q)]n(&(q)) + c(q), 


where function (vector) c(q) is orthogonal to a given subspace of zero bal¬ 
ances. This function have to be founded from the conditions of zero balances 
for the gradient grades'. For example, if the only balance is the conservation 
of the total probability, fP(q)dq = 1, then for the classical Boltzmann- 
Gibbs-Shannon entropy S 



(5.33) 


For the Kullback-form entropy (i.e. for the negative free energy or the 
Massieu-Planck function) 



the second differential and the entropic scalar product are the same, as for 
the classical Boltzmann-Gibbs-Shannon entropy, and 



(5.34) 


For more complicated system of balances, linear or non-linear, the system of 
linear equations for c(q) can also be written explicitly. 

5.4.4 Violation of the Transversality Condition, 

Singularity of Thermodynamic Projection, 
and Steps of Relaxation 

The thermodynamic projector transforms the arbitrary vector field equipped 
with the given Lyapunov function into a vector field with the same Lyapunov 
function for a given ansatz manifold which is not tangent to the Lyapunov 
function levels. Sometimes it is useful to create an ansatz which violates this 
transversality condition. The point of entropy maximum on such an ansatz is 
not the equilibrium. The usual examples are: the non-correlated approxima¬ 
tion x = ..., q n ) = Eli /fe)? the Gaussian manifold for a non-quadratic 

potential, etc. Such manifolds arise often in applications because of simplicity 
of computations. However, for these manifolds the thermodynamic projector 
becomes singular in the point of entropy maximum x* on the ansatz manifold. 
This is obvious from (5.32): in the neighborhood of x* it has the form 


P(J) = P 



(5.35) 
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where Ax = x — x* is the deviation of x from x*, a(x*) = (grad,,. S' 1 - | J) x , 
is the entropy production at the point x*, cr(x*) ^ 0, because the point of 
entropy maximum x* is not the equilibrium. In this case the projected system 
in the neighborhood of x* reaches the point x* in finite time t* as a/P — t 
goes to zero. The entropy difference AS = S(x) — S(x*) = —^(Ax\Ax) x * + 
o((Ax\Ax) x *) goes to zero as — cr(x*)(t* — t) (t < t*). 

The singularity of projection has a transparent physical sense. The relax¬ 
ation along the ansatz manifold to the point x * is not complete, because this 
point is not the equilibrium. This motion should be considered as a step of 
relaxation, and after it was completed, the next step should start. In that 
sense it is obvious that the motion to the point x* along the ansatz manifold 
should take the finite time. The results of this step-by-step relaxation can 
represent the whole process (with smoothing [26], or without it [27]). The 
experience of such a step-by-step computing of relaxation trajectories in the 
initial layer problem for the Boltzmann kinetics demonstrated its efficiency 
(see [26,27] and Sect. 9.3). 

5.4.5 Thermodynamic Projector, Quasiequilibrium, 
and Entropy Maximum 

The thermodynamic projector projects any vector field which satisfies the 
second law of thermodynamics into the vector field which satisfies the second 
law too. Other projectors violate the second law. But what does it mean? 
Each projector P x onto tangent space of an ansatz manifold in a point x 
induces the fast-slow motion splitting: Fast motion is the motion parallel to 
ker P x (on the affine subspace x + ker P x in the neighborhood of x), slow 
motion is the motion on the slow manifold and in the first order it is parallel 
to the tangent space T x in the point x (in the first order this slow manifold 
is the affine subspace x + imP x , T x = imP x ), and velocity vector of the slow 
motion in point x belongs to the image of P x . 

If P x is the thermodynamic projector, then x is the point of entropy 
maximum on the affine subspace of fast motion x+ker P x . It gives the solution 
to the problem 


S(z) —> max, z G x + ker P x . (5.36) 

This is the most important property of thermodynamic projector. It was 
introduced in [9] as the main thermodynamic condition for model reduction. 
Let us call it for nonequilibrium points x the property A: 

A. ker Pc C ker D X S . (5.37) 

If the projector P x with the property A can be continued to the equilib¬ 
rium point, x eq , as a smooth function of x, then in this point ker P x _L imP^. 
If this is valid for all systems (including systems with additional linear con¬ 
servation laws), then the following property B holds: 
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B. (ker P x |^| kei D X S) _L (imP x ^keiD X S) . (5.38) 

Of course, orthogonality in (5.37, 5.38) is considered with respect to the 
entropic scalar product in the point x. 

The property A means that the value of the entropy production persists 
for all nonequilibrium points. The sense of the property B is: each point of 
the slow manifold can be made an equilibrium point (after a deformation 
of the system which leads to an additional balance). And for equilibrium 
points the orthogonality condition (5.38) follows from the property A. 

If P x does not have the property A, then x is not the point of entropy 
maximum on the affine subspace of fast motion x + kerP^, so either the 
fast motion along this subspace does not leads to x (and, hence, the point 
x does not belong to the slow manifold), or this motion violates the second 
law, and the entropy decreases. This is the violation of the second law of 
thermodynamics during the fast motion. If P x does not have the property A, 
then such a violation is expected for almost every system. 

On the other hand, if P x is not the thermodynamic projector, then 
there exists a thermodynamically consistent vector field J, with a non¬ 
thermodynamic projection: S is the Lyapunov function for J (it increases), 
and is not the Lyapunov function for P X (J) (it decreases in the neighborhood 
of x). The difference between violation of the second law of thermodynamics 
in fast and slow motions for a projector without the property A is: for the 
fast motion this violation typically exists, for the slow (projected) motion 
there exist some thermodynamic systems with such a violation. On the other 
hand, the violation of thermodynamics in the slow motion is worse for appli¬ 
cations, if we use the slow dynamics as the answer (and assume that the fast 
dynamics is relaxed). 

If P x does not have the property B, then there exist systems with violation 
of the second law of thermodynamics in fast and slow motions. Here we can 
not claim that the second law is violated for almost every system, but such 
systems exist. 

One particular case of the thermodynamic projector is known during sev¬ 
eral decades. It is the quasiequilibrium projector (5.15) on the tangent space 
of the quasiequilibrium (MaxEnt) manifold (5.5) S(x) —> max, TI(x) = y. The 
solution of the problem (5.5) x^ e parametrized by values of the macroscopic 
variables y is the quasiequilibrium manifold. 

The formula for the quasiequilibrium projector (5.15) was essentially ob¬ 
tained by Robertson [126]. In his dissertation [126] Robertson studied “the 
equation of motion for the generalized canonical density operator”. The gen¬ 
eralized canonical density renders entropy a maximum for given statistical 
expectations of the thermodynamic coordinates. Robertson considered the 
Liouville equation for a general quantum system. The first main result of 
Robertson’s paper is the explicit expression for splitting of the motion in two 
components: projection of the motion onto generalized canonical density and 
the motion in the kernel of this projection. The obtained projector operator 
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is a specific case of the quasiequilibrium projector (5.15). The second result 
is the exclusion of the motion in the kernel of quasiequilibrium projector 
from the dynamic equation. This operation is similar to the Zwanzig for¬ 
malism [125]. It leads to the integro-differential equation with delay in time 
for the generalized canonical density. The quasiequilibrium projector (5.15) 
is more general than the projector obtained by Robertson [126] in the fol¬ 
lowing sense: It is derived for any functional S with non-degenerate second 
differential for the manifold of conditional maxima of S', and for any 

(nonlinear) evolution equation. Robertson emphasized that this operator is 
non-Hermitian with respect to standard L 2 scalar product and in that sense 
is “not a projector at all”. Nevertheless, it is self-adjoint (and, hence, or¬ 
thogonal), but with respect to another (entropic) scalar product. The general 
thermodynamic projector (13.4) performs with an arbitrary ansatz manifolds 
(not obligatory MaxEnt) and in that sense it is much more general. 

The thermodynamic projector (5.15) for the quasiequilibrium manifold 
(5.5) is the orthogonal projector with respect to the entropic scalar product 
(5.14). In this case both terms in the thermodynamic projector (5.25) are 
orthogonal projectors with respect to the entropic scalar product (5.14). The 
first term, Po? is orthogonal projector by construction. For the second term, 
e g (D x S ), it means that the Riesz representation of the linear functional D X S 
in the whole space E with respect to the entropic scalar product belongs to the 
tangent space of the quasiequilibrium manifold. This Riesz representation is 
the gradient of S with respect to (|) x . The following Proposition gives a simple 
and important condition of orthogonality of the thermodynamic projector 
(5.25). Let Q be an ansatz manifold, and let V be some quasiequilibrium 
manifold, x G 12 n v,t x be the tangent space to the ansatz manifold Q in 
the point x. Suppose that there exists a neighborhood of x where V C Q. We 
use the notation grades' for the Riesz representation of the linear functional 
D X S in the entropic scalar product (| ) x : (grad x S\f) x = ( D x S){f ) for / G E. 

Proposition 4. Under given assumptions, grades' G T x , and the thermody¬ 
namic projector P x is the orthogonal projector onto T x with respect to the 
entropic scalar product (5.1j). □ 

So, if a point x on the ansatz manifold Q belongs to some quasiequilib¬ 
rium submanifold V C 12, then the thermodynamic projector in this point is 
simply the orthogonal projector with respect to the entropic scalar product 
(13.2). 

Proposition 4 is useful in the following situation. Let the quasiequilib¬ 
rium approximation be more or less satisfactory, but the “relevant degrees of 
freedom” depend on the current state of the system. It means that for some 
changes of the state we should change the list of relevant macroscopic vari¬ 
ables (moments of distribution function for generating the quasiequilibrium, 
for example). Sometimes it can be described as presence of “hidden” degrees 
of freedom, which are not moments. In these cases the manifold of reduced 
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description should be extended. We have a family of systems of moments 
M a = m a (x), and a family of corresponding quasiequilibrium manifolds I2 a \ 
The manifold 12 a consist of solutions of optimization problem S(x) —■> max, 
m a (x) = Af for given a and all admissible values for M. To create a mani¬ 
fold of reduced description it is possible to join all the moments M a in one 
family, and construct the corresponding quasiequilibrium manifold. Points on 
this manifold are parametrized by the family of moments values {M a } for 
all possible a. It leads to a huge increase of the quasiequilibrium manifold. 
Another way of extension of the quasiequlibrium manifold is a union of all 
the manifolds 12 a for all a. In accordance with the Proposition 4, the ther¬ 
modynamic projector for this union is simply the orthogonal projector with 
respect to the entropic scalar product. This kind of manifolds gives a closest 
generalization of the quasiequilibrium manifolds. Due to (5.36), the thermo¬ 
dynamic projector gives the presentation of almost arbitrary ansatz as the 
quasiequilibrium manifold. This property opens the natural field for applica¬ 
tions of thermodynamic projector: construction of Galerkin approximations 
with thermodynamic properties. 

Of course, there is a “law of the difficulty conservation”: for the quasi- 
equilibrium with the moment parameterization the slow manifold is usually 
not explicitly known, and it can be difficult to calculate it. Thermodynamic 
projector completely eliminates this difficulty: we can use almost any man¬ 
ifold as appropriate ansatz now. On the other side, on the quasiequilibrium 
manifold with the moment parameterization (if it is found) it is easy to find 
the dynamics: simply write M = 77(7). Building of the thermodynamic pro¬ 
jector may require some effort. Finally, if the quasiequilibrium manifold is 
found, then it is easy to find the projection of any distributions x on the 
quasiequilibrium manifold: x i—► JJ(x) i—► If requires just a calculation 

of the moments II(x). The preimage of the point is a set (an affine 

manifold) of distributions {x\II(x — x^^) = 0}, and is the point of 

entropy maximum on this set. It is possible, but not so easy, to construct such 
a projector of some neighborhood of the manifold 12 onto 12 for the general 
thermodynamic projector P x : for a point z from this neighborhood 

z i—► x G J2, if P x (z — x) = 0 . (5.39) 

A point x G 12 is the point of entropy maximum on the preimage of x, i.e. 
on the affine manifold {z\P x (z — x) =0}. It is necessary to emphasize that 
the map (5.39) can be defined only in a neighborhood of the manifold 7?, but 
not in the whole space, because some of affine subspaces {z\P x (z — x) = 0} 
for different x E 12 can intersect. Let us introduce a special notation for the 
projection of some neighborhood of the manifold 12 onto !?, associated with 
the thermodynamic projector P x (5.39): : z x. The preimage of a point 

x G 12 is: 

= x + ker P x , 


(5.40) 
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(or, strictly speaking, a vicinity of x in this affine manifold). Differential of 
the operator at a point x G i? from the manifold Q is simply the projector 

Px. 

Pn(x + ez) = x + eP x z + 0(5) . (5.41) 

Generally, differential of P^ at a point x has not so simple form, if x does 
not belong Q. 

The “global extension” Pq of a field of “infinitesimal” projectors Pf 
(/ G f2) is needed for a discussion of projector operators technique, memory 
functions and a short memory approximation. 

Is it necessary to use the thermodynamic projector everywhere? The per¬ 
sistence of dissipation is necessary, because the violation of the second law 
may lead to non-physical effects. If one creates a very accurate method for 
solution of the initial equation (3.1), then it may be possible to expect that 
the persistence of dissipation will hold without additional effort. But this 
situation does not appear yet. All methods of model reduction need a special 
tool to control the persistence of dissipation. 

In order to summarize, let us give three reasons to use the thermodynamic 
projector: 

1. It guarantees the persistence of dissipation: all the thermodynamic processes 
which should produce the entropy conserve this property after projecting, 
moreover, not only the sign of dissipation conserves, but also the value of 
entropy production and the reciprocity relations are conserved; 

2. The coefficients (and, more generally speaking, the right hand part) of ki¬ 
netic equations are less known than the thermodynamic functionals, so, the 
universality of the thermodynamic projector (it depends only on thermo¬ 
dynamic data) makes the thermodynamic properties of projected system 
as reliable, as for the initial system; 

3. It is easy (much more easy than the spectral projector, for example). 


5.5 Example: Quasiequilibrium Projector 
and Defect of Invariance 
for the Local Maxwellians Manifold 
of the Boltzmann Equation 

The Boltzmann equation remains the most inspiring source for the model 
reduction problems. With this subsection we start a series of examples for 
the Boltzmann equation. 
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5.5.1 Difficulties of Classical Methods 
of the Boltzmann Equation Theory 

The first systematic and (at least partially) successful method of construct¬ 
ing invariant manifolds for dissipative systems was the celebrated Chapman- 
Enskog method [70] for the Boltzmann kinetic equation (see Chap. 2). The 
main difficulty of the Chapman-Enskog method [70] are “nonphysical” prop¬ 
erties of high-order approximations. This was stated by a number of authors 
and was discussed in detail in [112]. In particular, as it was noted in [72], the 
Burnett approximation results in a short-wave instability of the acoustic spec¬ 
tra. This fact contradicts the i7-theorem (cf. in [72]). The Hilbert expansion 
contains secular terms [112]. The latter contradicts the i7-theorem. 

The other difficulties of both of these methods are: the restriction upon 
the choice of the initial approximation (the local equilibrium approximation), 
the requirement for a small parameter, and the usage of slowly converging 
Taylor expansion. These difficulties never allow a direct transfer of these 
methods on essentially nonequilibrium situations. 

The main difficulty of the Grad method [201] is the uncontrollability of 
the chosen approximation. An extension of the list of moments can result in a 
certain success, but it can also give nothing. Difficulties of moment expansion 
in the problems of shock waves and sound propagation are discussed in [112]. 

Many attempts were made to refine these methods. For the Chapman- 
Enskog and Hilbert methods these attempts are based in general on some 
better rearrangement of expansions (e.g. neglecting high-order derivatives 
[112], reexpanding [112], Pade approximations and partial summing [43,221, 
233], etc.). This type of work with formal series is wide spread in physics. 
Sometimes the results are surprisingly good - from the renormalization theory 
in quantum fields to the Percus-Yevick equation and the ring-operator in 
statistical mechanics. However, one should realize that success cannot be 
guaranteed. Moreover, rearrangements never remove the restriction upon the 
choice of the initial local equilibrium approximation. 

Attempts to improve the Grad method are based on quasiequilibrium ap¬ 
proximations [223,224]. It was found in [224] that the Grad distributions 
are linearized versions of appropriate quasiequilibrium approximations (see 
also [230,233,234]). A method which treats fluxes (e.g. moments with re¬ 
spect to collision integrals) as independent variables in a quasiequilibrium 
description was introduced in [233,234,246,248], and will be discussed later 
in Example 5.6. 

The important feature of quasiequilibrium approximations is that they 
are always thermodynamic, i.e. they are consistent with the i7-theorem by 
construction. However, quasiequilibrium approximations do not remove the 
uncontrollability of the Grad method. Dynamic corrections to Grad’s approx¬ 
imation will be addressed later in Chap. 6. 
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5.5.2 Boltzmann Equation 

The phase space E consists of distribution functions f(v,x) which depend on 
the spatial variable x and on velocity variable v. The variable x spans an open 
domain C R x , and the variable v spans the space Rj. We require that 
f(v,x) G F are nonnegative functions, and also that the following integrals 
are finite for every x G 12 x (the existence of the moments and of the entropy): 

4' 1<2i3) (/) = J v[ 1 v i 2 2 v i 3 3 f(v,x)d 3 v,i 1 > 0,i 2 > 0,i 3 > 0 ; (5.42) 

HM) = j f( v , x)(\n f(v, x) — 1) d 3 ®, H(f) = j //*(/) d 3 ® . (5.43) 

Here and below integration in v is done over Rj, and it is done over Q x in x. 
For every fixed x G b? x , 7® and H x might be treated as functionals defined 
in F. 

We write the Boltzmann equation in the form of (3.1) (in the fixed refer¬ 
ence system) using standard notation [112]: 

K = j(f), j{f) = ~ v ^ + Q(/. /) • (5-44) 

Here and further in this Example summation in two repeated indices is as¬ 
sumed, and Q(/, /) stands for the Boltzmann collision integral. The latter 
represents the dissipative part of the vector field J(f) (5.44). 

In this section we consider the case when boundary conditions for equation 
(5.44) are relevant to the local with respect to x form of the H-theorem. 

For every fixed cc, we denote as i7^(/) the space of linear functionals 

4 f 

E/ ai (x) / ipi{v)f{v,x)d 3 v , 

i=0 '' 

where represent invariants of a collision (^o = 1 , V’z = = 

1,2, 3,^4 = f 2 ). We write (mod7^.(/)) if an expression is valid within the 
accuracy of adding a functional from H®(f). The local i7-theorem states: for 
any functional 

H x (f) = J f(v,x)(lnf(v,x) - l)d 3 ® (modi^(/)) (5.45) 

the following inequality is valid: 

-fjp- - JQ(f’f)\ f = f(VtX) ^f(v, ®)d 3 -w < 0 . (5.46) 

Expression (5.46) is equal to zero if and only if In / = a i{ x )^i( v ) - 
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Although all functionals (5.45) are equivalent in the sense of the H- 
theorem, it is convenient to work with the functional 



All what was said in this chapter can be applied to the Boltzmann equation 
(5.44). Now we shall discuss some specific points. 

5.5.3 Local Manifolds 

Although the general description of manifolds Q C F holds applies also to 
the Boltzmann equation, a specific class of manifolds can be defined due to 
the different character of spatial and velocity dependencies in the Boltzmann 
equation vector field (5.44). These manifolds will be called local manifolds, 
and they are constructed as follows. Denote as F\ oc the set of functions f(v) 
with finite integrals 



(5.47) 


In order to construct a local manifold in F, we, first, consider a manifold 
in F\ oc . Namely, we define a domain ic5, where B is a linear space, and 
consider a smooth immersion A —> F\ oc : a —> The set of functions 

/(a, v) G Fioc, where a spans a domain A , is a manifold in Fi oc . Second, we 
consider all bounded and sufficiently smooth functions a{x)\ fi x —> A, and 
we define the local manifold in F as the set of functions f(a(x),v). Roughly 
speaking, the local manifold is a set of functions which are parameterized 
with cc-dependent functions a(x). A local manifold will be called a locally 
finite-dimensional manifold if B is a finite-dimensional linear space. 

Locally finite-dimensional manifolds are the natural source of initial ap¬ 
proximations for constructing dynamic invariant manifolds in the Boltzmann 
equation theory. For example, the Tamm-Mott-Smith (TMS) approximation 
is a locally two-dimensional manifold {/(a_, a + )} which consists of distribu¬ 
tions 


/(a_,a+) = a_/_ +a+f+ . 


(5.48) 


Here a_ and a + (the coordinates on the manifold L?tms = {/(a_,a+)}) are 
non-negative real functions of the position vector cc, and /_ and /+ are fixed 
up- and downstream Maxwellians. 

The next example is the locally five-dimensional manifold {/(n, u, T)} 
which consists of local Maxwellians (LM). The LM manifold consists of dis¬ 
tributions /o which are labeled with parameters n, u, and T: 



(5.49) 
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Parameters n, u, and T in (5.49) are functions of x. In this section we 
shall not indicate this dependency explicitly. 

Distribution /o (n, u, T ) is the unique solution of the variational problem: 



^ / In / d 3 v —> min 

M 0 (f) = 

f WdV; 

Mi{f) = 

j " Vif d 3 v = nui,i = 1,2,3 

M 4 (/) = 

f 2 ^3 3uA)bT 2 

v j d r =-b mx 

J rn 


Hence, the LM manifold is the quasiequilibrium manifold. Considering n, u, 
and T as five parameters, we see that the LM manifold is parameterized with 
the values of M s (/), s = 0,..., 4, which are defined in the neighborhood of the 
LM manifold. It is sometimes convenient to consider the variables M s (/o), s = 
0,..., 4, as a new coordinates on the LM manifold. The relationship between 
the coordinates {M s (/ 0 )} and {n, u, T} is: 


n - M 0 ; Ui = M 0 1 Mi , i =» 1, 2 , 3; T 


—M 0 - 1 (M 4 - Mo'MiMi) . 


(5.51) 


This is the standard moment parametrization of the quasiequilibrium 
manifold. 


5.5.4 Thermodynamic Quasiequilibrium Projector 

Thermodynamic quasiequilibrium projector Pf 0 ( n ,u,T)(J) onto the tangent 
space is defined as: 

P M n, U ,T)(J) = E df 0 QM s ' T) j ^' (5 ' 52) 

Here we have assumed that n, u, and T are functions of Mq,...,M 4 (see 
relationship (5.51)), and 

V’o = rV’*— = 1,2,3,^4 = f 2 • (5.53) 

Calculating derivatives in (5.52), and next returning to variables n, n, and 
T, we obtain: 


Pf 0 (n,u,T)(J) — fo(n,u,T) 

f f 1 mui f mu 2 T\ f m(v — u) 2 

X ( [ra ~~ nk B T^ Vi ~ Ui ^ + V3nfc B ~~ n J ( 2fc B T 2 



(5.54) 

/ Jd ** 
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m 2 mui / m(v — u) 2 3 \ 

nk B T {Vl ~ Ui ’ ~ 3nfc B \ 2A: B T 2 2T/ 

m / m(v — '**^ 2 


J ViJ d 3 v 




3nk B V 2&bT 2 

It is sometimes convenient to rewrite (5.55) as 

4 r 

Pfo(n,u,T)(J ) = /o(n,, tX,T) ^fnfn.U.T) / ^ 

s=0 J 


Here 


V’/o(„,„,r) = n 1/2 ’ ^fo(n, U ,T) = (2/n) 1/2 d 


Mn,u,T)Jd 3 v. (5.55) 


(5.56) 


(4) = (2/3n) 1 / 2 (c 2 - (3/2)); c; = (m/2fc B T) 1 / 2 (t; i - «*), i = 1,2,3 . 


^fo(n,u,T) 

It is easy to check that 

/ h{n,u,T)i> 


( fe ) v/0 

fo(n,u,T) Vf 0 ( n ,u,T) 


d « = 4; . 


(5.57) 


Here Ski is the Kronecker delta. 


5.5.5 Defect of Invariance for the LM Manifold 


The defect of invariance for the LM manifold at the point /o (n, u, T) for the 
Boltzmann equation vector field in the co-moving reference system is: 


A(fo(n,u,T)) = Pf 0 (n, u ,T) C-(v a + Q(fo(n,u,T)) 

~ (~(v s - + Q(fo(n,u,T )) 

dfo(n,u,T)\ +{vs _ Us) dfo^ 1 u 1 T) ^ 


( .. ,df 0 (n,u,T)\ 

~ Pfo(n,u,T) L ( v s U s ) J 


dx s 


Substituting (5.55) into (5.58), we obtain: 
Z\(/ 0 (n, u, T)) = /o(n, u, T) | 


-u) 2 5\ ,dlnT 

2*^-2) (,, ‘-“‘ ) ^r 


+ 7^7= (((Ui — Ui)(v s — U s ) — Ljafa — u) 2 )^A 

k B T yyy A ' 3 v ; ’ dxi 


}■ 


(5.59) 


The LM manifold is not a dynamic invariant manifold of the Boltzmann 
equation and the defect (5.59) is not equal to zero. Indeed, inhomogeneity of 
the temperature and of the flow velocity drives the invariant manifold away 
from the local equilibrium. 
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5.6 Example: Quasiequilibrium Closure Hierarchies 
for the Boltzmann Equation 

Explicit method of constructing approximations (the Triangle Entropy Me¬ 
thod [233]) is developed for strongly nonequilibrium problems of Boltz- 
mann’s-type kinetics, i.e. when the standard moment variables become in¬ 
sufficient. This method enables one to treat any complicated nonlinear func¬ 
tionals that fit best the physics of a problem (such as, for example, rates of 
processes) as new independent variables. 

The method is applied to the problem of derivation of hydrodynamics 
from the Boltzmann equation. New macroscopic variables are introduced 
(moments of the Boltzmann collision integral, or scattering rates). They are 
treated as independent variables rather than as infinite moment series. This 
approach gives the complete account of rates of scattering processes. Trans¬ 
port equations for scattering rates are obtained (the second hydrodynamic 
chain), similar to the usual moment chain (the first hydrodynamic chain). Us¬ 
ing the triangle entropy method, three different types of the macroscopic de¬ 
scription are considered. The first type involves only moments of distribution 
functions, and results coincide with those of the Grad method in the Maxi¬ 
mum Entropy version. The second type of description involves only scattering 
rates. Finally, the third type involves both the moments and the scattering 
rates (the mixed description). The second and the mixed hydrodynamics 
are sensitive to the choice of the collision model. The second hydrodynam¬ 
ics is equivalent to the first hydrodynamics only for Maxwell molecules, and 
the mixed hydrodynamics exists for all types of collision models excluding 
Maxwell molecules. Various examples of the closure of the first, of the second, 
and of the mixed hydrodynamic chains are considered for the hard spheres 
model. It is shown, in particular, that the complete account of scattering 
processes leads to a renormalization of transport coefficients. 

5.6.1 Triangle Entropy Method 

In the present subsection, which is of introductory character, we shall refer, to 
be specific, to the Boltzmann kinetic equation for a one-component gas whose 
state (in the microscopic sense) is described by the one-particle distribution 
function f(y,x,t) depending on the velocity vector v = {vk}\ =1 , the spatial 
position x = {xk}\ =1 and time t. The the Boltzmann equation describes the 
evolution of / and in the absence of external forces is 

d t f + v k d k f = Q(f, /) , (5.60) 

where () t = d/dt is the time partial derivative, ()/■ = d/dx/~ is partial deriva- 
tive with respect to k -th component of cc, summation in two repeating indices 
is assumed, and Q(/, /) is the collision integral (its concrete form is of no im¬ 
portance right now, just note that it is functional-integral operator quadratic 
with respect to /). 
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The Boltzmann equation possesses two properties principal for the sub¬ 
sequent reasoning (for the basic properties of the Boltzmann equation see 
Chap. 2) . 

1. There exist five functions ^ a (v) (additive collision invariants), 

l,v,v 2 

such that for any their linear combination with coefficients depending on x,t 
and for arbitrary / the following equality is true: 

5 

/ X! ^)V’a(v)Q(/, f)dv = 0 , (5.61) 

'' a=l 

provided the integrals exist. 

2. The equation (5.60) possesses global Lyapunov functional: the H- 
function, 

H ( t )= H [f} = Jf(v,x,t)lnf(v,x,t)dvdx, (5.62) 

the derivative of which by virtue of the equation (5.60) is non-positive under 
appropriate boundary conditions: 

dH(t)/dt < 0 . (5.63) 

Grad’s method [201] and its variants construct closed systems of equations 
for macroscopic variables when the latter are represented by moments (or, 
more general, linear functionals) of the distribution function / (hence their 
alternative name is the “moment methods”). The entropy maximum method 
for the Boltzmann equation is of particular importance for the subsequent 
reasoning. It consists in the following. A finite set of moments describing the 
macroscopic state is chosen. The distribution function of the quasiequilibrium 
state under given values of the chosen moments is determined, i.e. the problem 
is solved 

H[f] -> min, for Mi[f] = M i? i = 1,..., k , (5.64) 

where Mi[f] are linear functionals with respect to /; Mi are the corresponding 
values of chosen set of k macroscopic variables. The quasiequilibrium distri¬ 
bution function /*(t;, M(cc, £)), M = {Mi,..., M^}, parametrically depends 
on M^, its dependence on space x and on time t being represented only by 
M(x,t). Then the obtained /* is substituted into the Boltzmann equation 
(5.60), and operators Mi are applied on the latter formal expression. 

In the result we have closed systems of equations with respect to Mi(x , £), 
i = 1 ,..., k: 

d t M t + M l [v k d k f%v,M)]=M l [Q(f%v,M)J*(v,M))} . (5.65) 

The following heuristic explanation can be given to the entropy method. 
A state of the gas can be described by a finite set of moments on some time 
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scale 9 only if all the other moments (“fast”) relax on a shorter time scale time 
r,r <C to their values determined by the chosen set of “slow” moments, 
while the slow ones almost do not change appreciably on the time scale r. 
In the process of the fast relaxation the H- function decreases, and in the 
end of this fast relaxation process a quasiequilibrium state sets in with the 
distribution function being the solution of the problem (5.64). Then “slow” 
moments relax to the equilibrium state by virtue of (5.65). 

The entropy method has a number of advantages in comparison with the 
classical Grad’s method. First, being not necessarily restricted to any specific 
system of orthogonal polynomials, and leading to solving an optimization 
problem, it is more convenient from the technical point of view. Second, and 
ever more important, the resulting quasiequilibrium H- function, H*(M) = 
H[f*(v,M)\, decreases due of the moment equations (5.65). 

Let us note one common disadvantage of all the moment methods, and, in 
particular, of the entropy method. Macroscopic parameters, for which these 
methods enable to obtain closed systems, must be moments of the distri¬ 
bution function. On the other hand, it is easy to find examples when the 
interesting macroscopic parameters are nonlinear functionals of the distrib¬ 
ution function. In the case of the one-component gas these are the integrals 
of velocity polynomials with respect to the collision integral Q(f, /) of (5.60) 
(scattering rates of moments). For chemically reacting mixtures these are the 
reaction rates, and so on. If the characteristic relaxation time of such nonlin¬ 
ear macroscopic parameters is comparable with that of the “slow” moments, 
then they should be also included into the list of “slow” variables on the same 
footing. 

In this Example for constructing closed systems of equations for non¬ 
linear (in a general case) macroscopic variables the triangle entropy method 
is used. Let us outline the scheme of this method. 

Let a set of macroscopic variables be chosen: linear functionals M[f] and 
nonlinear functionals (in a general case) N[f]: 

M[f\ = {Mi[f],...,M k [f}}, N[f] = {N 1 [f],...,N l [f}} . 

Then, just as for the problem (5.64), the first quasiequilibrium approximation 
is constructed under fixed values of the linear macroscopic parameters M: 

H[f] min for M*[/] = Mi, i = 1 ,..., k , (5.66) 

and the resulting distribution function is After that, we seek the 

true quasiequilibrium distribution function in the form, 

/ = /*(l + y>) , (5-67) 

where ip is a deviation from the first quasiequilibrium approximation. In order 
to determine ip, the second quasiequilibrium approximation is constructed. 
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Let us denote AH[f*,cp] as the quadratic term in the expansion of the H- 
function into powers of ip in the neighbourhood of the first quasiequilibrium 
state /*. The distribution function of the second quasiequilibrium approxi¬ 
mation is the solution to the problem, 

AH[f*, (p\ —> min for 

Miir<p] = o, i = i,...,k, 

AN j [f*,<p] = AN j , j = (5.68) 

where ANj are linear operators characterizing the linear with respect to 
ip deviation of (nonlinear) macroscopic parameters Nj from their values, 
Nj = Nj [/*], in the first quasiequilibrium state. Note the importance of 
the homogeneous constraints Mi[f*ip] = 0 in the problem (5.68). Physically, 
it means that the variables ANj are “slow” in the same sense, as the variables 
M^, at least in the small neighborhood of the first quasiequilibrium /*. The 
obtained distribution function, 

/ = />, M)(l + M, AN)) (5.69) 

is used to construct the closed system of equations for the macroparameters 
M, and AN. Because the functional in the problem (5.68) is quadratic, and 
all constraints in this problem are linear, it is always explicitly solvable. 

Further in this section some examples of using the triangle entropy method 
for the one-component gas are considered. Applications to chemically reacting 
mixtures were discussed in [246,247]. 

5.6.2 Linear Macroscopic Variables 

Let us consider the simplest example of using the triangle entropy method, 
when all the macroscopic variables of the first and of the second quasiequi¬ 
librium states are the moments of the distribution function. 

Quasiequilibrium Projector 

Let /ii('u),..., /ife(v) be the microscopic densities of the moments 

Mi(x,t), ... ,M k (x,t ) 

which determine the first quasiequilibrium state, 

Mi(x,t) = Jm(v)f(v,x,t)dv , (5.70) 

and let v\{v ),..., vi(v) be the microscopic densities of the moments 


Ni(x,t), ... ,Ni(x,t) 
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determining together with (5.60) the second quasiequilibrium state, 


Ni(x,t) = / vi(v)f(v,x,t)dv 


(5.71) 


The choice of the set of the moments of the first and second quasiequilibrium 


approximations depends on a specific problem. Further on we assume that 
the microscopic density fi = 1 corresponding to the normalization condition is 
always included in the list of microscopic densities of the moments of the first 
quasiequilibrium state. The distribution function of the first quasiequilibrium 
state results from solving the optimization problem, 



(5.72) 


for 



Let us denote by M = {Mi,..., M&} the moments of the first quasiequi¬ 
librium state, and by /*(v,M) let us denote the solution of the problem 


(5.72). 


The distribution function of the second quasiequilibrium state is sought 
in the form, 




(5.73) 


Expanding the H -function (5.62) in the neighbourhood of /*(v, M) into pow¬ 
ers of p to second order we obtain, 



(5.74) 


where H*(M) = H[f*(v, M)\ is the value of the H -function in the first 
quasiequilibrium state. 

When searching for the second quasiequilibrium state, it is necessary that 
the true values of the moments M coincide with their values in the first 
quasiequilibrium state, i.e., 



(5.75) 


In other words, the set of the homogeneous conditions on p in the problem 


(5.68), 



(5.76) 
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ensures a shift (change) of the first quasiequilibrium state only due to the 
new moments TVi,..., Ni. In order to take this condition into account auto¬ 
matically, let us introduce the following structure of a Hilbert space: 

1. Define the scalar product 

(V’l,^) = J f*{v,M)ip i(«)V>2(v)du . (5.77) 

2. Let En be the linear hull of the set of moment densities 

{^(v),...,Hk(v)} . 

Let us construct a basis of {ei(v),..., e r (v)} that is orthonormal in 
the sense of the scalar product (5.77): 

( e z 5 e j) = Sij , (5.78) 


i, j = 1,..., r; dij is the Kronecker delta. 

3. Define a projector P* on the first quasiequilibrium state, 

r 

P*^ = Y / e i ( e i,4 ’)• (5.79) 

i =1 

The projector P* is orthogonal: for any pair of functions ^i,^, 

- P*)p2) = o , (5.80) 

where 1 is the unit operator. Then the condition (5.76) amounts to 

P*<p = 0, (5.81) 

and the expression for the quadratic part of the P-function (5.74) takes 
the form, 


= H*(M) + (In + (1/2)(ip, ip) . (5.82) 


Now, let us note that the function In/* is invariant with respect to the 
action of the projector P*: 


P* In/* a In/* . (5.83) 

This follows directly from the solution of the problem (5.72) using of the 
method of Lagrange multipliers: 


k 

f* = exp ^ Xi(M)fj.i(v) , 
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where A i(M) are Lagrange multipliers. Thus, if the condition (5.81) is satis¬ 
fied, then from (5.80) and (5.83) it follows that 

(In r,<p) = (P* In /*,(i-p» = 0. 

Condition (5.81) is satisfied automatically, if ANi are taken as follows: 

ANi = = 1,...,/ . (5.84) 

Thus, the problem (5.68) of finding the second quasiequilibrium state 
reduces to 


AH[f*,tp\ — H*(M) = (1/2min for 

((i - P*)vi, ip) = AN U i = 1, • • •, l • (5.85) 

Note that it is not ultimatively necessary to introduce the structure of the 
Hilbert space. Moreover that may be impossible, since the “distribution func¬ 
tion” and the “microscopic moment densities” are, strictly speaking, elements 
of different (conjugate one to another) spaces, which may be not reflexive. 
However, in the examples considered below the mentioned difference is not 
manifested. 

In the remainder of this section we demonstrate how the triangle entropy 
method is related to Grad’s moment method. 


Ten-Moment Grad Approximation 

Let us take the five additive collision invariants as moment densities of the 
first quasiequilibrium state: 


Ho ~ 1; Hk = Vk (k = 1,2,3); /m = —, (5.86) 

where Vk are Cartesian components of the velocity, and m is particle’s mass. 
Then the solution to the problem (5.72) is the local Maxwell distribution 
function f^\v,x,t): 




m(v — u(x, t)) 2 1 
2 k B T(x,t) ) 


(5.87) 


where 

n(x, t) = f f(v) di; is local number density, 

u(x,t) = n~ 1 (x^t) f f(v)vdv is the local flow density, 

T(x,t) = f f(v ) rn ^^ dv is the local temperature, 
kB is the Boltzmann constant. 

Orthonormalization of the set of moment densities (5.86) with the weight 
(5.87) gives one of the possible orthonormal basis 
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5& B T — rn(v — u) 2 
(10n) 1 / 2 /c B T 



(5.88) 


m(v — u) 2 


(15n) 1 / 2 /c B T* 


For the moment densities of the second quasiequilibrium state let us take, 


(5.89) 


v%k = mviVk, i, k = 1,2,3 . 


Then 



and, since ((i - P^)v ik , (i - P^)ui s ) (. Su5 ks + 5 k iS is )Pk B T/m, where 
P = nk B T is the pressure, and a ik = (/, (1 — is the traceless part 

of the stress tensor, then from (5.73), (5.86), (5.87), (5.90) we obtain the 
distribution function of the second quasiequilibrium state in the form 



(5.91) 


This is precisely the distribution function of the ten-moment Grad approxi¬ 
mation (let us recall that here summation in two repeated indices is assumed). 

Thirteen-Moment Grad Approximation 

In addition to (5.86), (5.89), let us extend the list of moment densities of the 
second quasiequilibrium state with the functions 


The corresponding orthogonal complements to the projection on the first 
quasiequilibrium state are 



(5.93) 


The moments corresponding to the densities (i — P^ 0 ))^ are the components 
of the heat flux vector qf. 


Qi = (<p,(i --P (0) )&) • 


Since 


(5.94) 
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((i - p ( 0) )&, (i - p ( 0) )%) = o, 


for any i, then the constraints 


((i - P { 0 ) )vi k ,ip) = mu, ((i - -P ( 0 ) )&,v?) = qi 


in the problem (5.85) are independent, and Lagrange multipliers correspond¬ 
ing to & are 



(5.95) 


Finally, taking into account (5.86), (5.91), (5.93), (5.95), we find the dis¬ 
tribution function of the second quasiequilibrium state in the form 



(5.96) 


which coincides with the thirteen-moment Grad distribution function [201]. 


Let us remark on the thirteen-moment approximation. From (5.96) it fol¬ 
lows that for large enough negative values of (vi—Ui) the thirteen-moment dis¬ 
tribution function becomes negative. This peculiarity of the thirteen-moment 
approximation is due to the fact that the moment density & is odd-order poly¬ 
nomial of Vi. In order to eliminate this difficulty, one may consider from the 
very beginning that in a finite volume the square of velocity of a particle 
does not exceed a certain value which is finite owing to the finiteness 

of the total energy, and qi is such that when changing to infinite volume 
qi —> 0, fmax 00 an d — U{)(v — u) 2 remains finite. 

On the other hand, the solution to the optimization problem (5.64) does 
not exist (is not normalizable), if the highest-order velocity polynomial is 
odd, as it is for the full 13-moment quasiequilibrium. 

Approximation (5.91) yields AH (5.82) as follows: 



(5.97) 


while AH corresponding to (5.96) is, 



(5.98) 


where p = ran, and H^ is the local equilibrium value of the H -function 



(5.99) 


These expressions coincide with the corresponding expansions of the qua- 
siequilibrium H -functions obtained by the entropy method, if microscopic 
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moment densities of the first quasiequilibrium approximation are chosen as 
1 and ViVj, or as 1, ViVj , and ViV 2 . As it was noted in [224], they differs 
from the H -functions obtained by the Grad method (without the maximum 
entropy hypothesis), and in contrast to the latter they give proper entropy 
balance equations. 

The transition to the closed system of equations for the moments of the 
first and of the second quasiequilibrium approximations is accomplished by 
proceeding from the chain of the Maxwell moment equations, which is equiv¬ 
alent to the Boltzmann equation. Substituting / in the form of + ip) 

into equation (5.60), and multiplying by and integrating over u, we 

obtain 


<9t(l,-P (0) MiO)) + d t (v(v), m(v)) + d k (v k ip(v), m(v)) 
+d k {v k ,Hi(v)) = M Q [m,<p] . 


(5.100) 


Here 



is a “moment” (corresponding to the microscopic density) jii(v) with respect 
to the collision integral (further we term Mq the collision moment or the 
scattering rate). Now, if one uses / given by equations (5.91), and (5.96) as 
a closure assumption, then the system (5.100) gives the ten- and thirteen- 
moment Grad equations, respectively, whereas only linear terms in p should 
be kept when calculating Mq. 

Let us note some limitations of truncating the moment hierarchy (5.100) 
by means of the quasiequilibrium distribution functions (5.91) and (5.96) 
(or for any other closure which depends on the moments of the distribution 
functions only). When such closure is used, it is assumed implicitly that the 
scattering rates in the right hand side of (5.100) “rapidly” relax to their 
values determined by “slow” (quasiequilibrium) moments. Scattering rates 
are, generally speaking, independent variables. This peculiarity of the chain 
(5.100), resulting from the nonlinear character of the Boltzmann equation, 
distinct it essentially from the other hierarchy equations of statistical me¬ 
chanics (for example, from the BBGKY chain which follows from the linear 
Liouville equation). Thus, equations (5.100) are not closed twice: into the left 
hand side of the equation for the i-th moment enters the (i + l)-th moment, 
and the right hand side contains additional variables - scattering rates. 

A consequent way of closure of (5.100) should address both sets of vari¬ 
ables (moments and scattering rates) as independent variables. The triangle 
entropy method enables to do this. 


5.6 Example: Quasiequilibrium Hierarchies for the Boltzmann Equation 113 

5.6.3 Transport Equations for Scattering Rates 
in the Neighbourhood of Local Equilibrium. 

Second and Mixed Hydrodynamic Chains 

In this section we derive equations of motion for the scattering rates. It proves 
convenient to use the following form of the collision integral Q(/, /): 

Q{fJ){v) = J w(v' 1 ,v'\v,vi)(f(v t )f(v' 1 ) - f(y)f(yi)) dv'dv' x dvi , 

(5.101) 

where v and v± are velocities of the two colliding particles before the collision, 
v' and v[ are their velocities after the collision, re is a kernel responsible for 
the post-collision relations v f (v,vi) and momentum and energy 

conservation laws are taken into account in w by means of corresponding 
^-functions. The kernel w has the following symmetry property with respect 
to its arguments: 

w^v^v'\v, Vi) = w(vi,v f \vi,v) = w(v', v[ \ vi,v) = w(v, v\ \ v', v[) . 

(5.102) 

Let fi{v) be the microscopic density of a moment M. The corresponding 
scattering rate Mq[/, g] is defined as follows: 

M Q[f,lA = jQ{f,f){v)n{v)dv . (5.103) 

First, we should obtain transport equations for scattering rates (5.103), 
analogous to the moment’s transport equations. Let us restrict ourselves to 
the case when / is represented in the form, 

/ = / ( °)( 1 + ^0, (5-104) 

where is local Maxwell distribution function (5.87), and all the quadratic 

with respect to ip terms will be neglected below. It is the linear approximation 

around the local equilibrium. 

Since, by detailed balance, 

/(°)(«)/(°>M = / (t V)/ (0) K) (5.105) 

for all such (u, Vi), (v', v[) which are related to each other by conservation 
laws, we have, 

^q[/ (0 \m] = 0, for any fi . (5.106) 

Further, by virtue of conservation laws, 

= 0, for any / . (5.107) 


From (5.105)-(5.107) it follows, 
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M 0 [/<°>( 1 + <p),li]=M Q [p ,(i - P (0 V] (5-108) 

= — J w{v',v\ | ■yi)/^°^(' u )/^°^(' u i) |(1 — -P^)/4 V )} dv'du, dvidv . 

We used notation, 

{ ip{v )} = ip(v) + ^(vi) - ^(t/) - ^(v'i) . (5.109) 

Also, it proves convenient to introduce the microscopic density of the scat¬ 
tering rate, /jlq(v): 

Hq{v) = J w(v',v' 1 \v,v 1 )f^ 0 \v 1 )^(l-P^' , )iJ,(v)^ dv'dv^dv! . (5.110) 
Then, 

Mq[ViIj\ = —(ip,[iq) , (5.111) 

where (•,•) is the L 2 scalar product with the weight f t<r> (5.87). This is a 
natural scalar product in the space of functions ip (5.104) (multipliers), and it 
is obviously related to the entropic scalar product in the space of distribution 
functions at the local equilibrium f(°\ which is the L 2 scalar product with 
the weight (Z^ 0 ^) -1 . 

Now, we obtain transport equations for the scattering rates (5.111). We 
write down the time derivative of the collision integral due to the Boltzmann 
equation, 

dtQ(f, f)(v) = TQ(f, f)(v) + RQ(f, f)(v) , (5.112) 

where 

TQ(f,f) (v) = j w{v',v' 1 \v,v l )lf(v)v lk dkf{v 1 ) + f(vi)v k d k f(v) 

~ f( v ') v ikdkf(v 1) - fiv'Pv^dkfiv')} dv' dv\ dui dv ; (5.113) 
RQ(f,f)(v) = J w{v',v[ I v,vi) [Q(f,f)(v')f(v , 1 ) + Q(f,f)(v' 1 )f(v') 

~ Q(f, f)(vi)f(v) - Q(f, f)(v)f(v i)] dv' dv, dvi dv . (5.114) 
Using the representation, 


dkf (0 \v) = A k (v)f {0 \v) ; (5.115) 

Ak{v) = d k In(nT _3/2 ) + j^=(vi - Ui)d k Ui + ^^7 A d k InT , 

and after some simple transformations using the relation 

(A fe (v)} = 0 , (5.116) 

in linear with respect to ip deviation from / (5.104), we obtain in (5.112): 
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TQ(f,f)(v) = d k J w(v',v i | v,vi)/ (0) (vi)/ (0) (v) {v k <p(v)} dvidw'dwi 
+ J w(v',v i | w, vi)/ (0) (wi)/ (0) (w) {w fe ,4fe(v)} dv'dvidwi 

+ J w(v',V i | f,Vl)/ (0) (v)/ (0) (Vl) b(w)^fc(ui)(uifc - Wfc) 

+^(vi)Ajk(t;)(v fe - wi fe ) + 9?(v')^fe(v , 1 )(wfe - wife) 



+ (^(v / 1 )x4/ c ( 

v ’)Wik ~ v 'k)\ dw'idw'dwi ; 

(5.117) 

RQ(fJ)(v) = 

J w(v',v- i 1 

v, vi )/ (0) (w)/ (0) (wi) {£(w)} dwi dv' dwi 


t(v) = 

J w(v',v- i 1 

w, ' u i)/^(' y i) (<£>(w)} dw'i dw' dwi ; 

(5.118) 

d t Q(fJ)(v) 



(5.119) 

= 

-<9 t J w(v', 

w'i | v,fi)/ (0) (v)/ (0) (vi) {¥?(«)} di/dw- 

L dvi . 


Let us use two identities: 

1. From the conservation laws it follows 

{¥>(«)} = {(i --P (0) M«)} • (5-120) 

2. The symmetry property of the kernel w (5.102) which follows from (5.102), 
(5.105) 

J w(v',v i | w, vi)/ (0) (vi)/ (0) (v) 5 i(v) { 5 2 (v)} d-i/ dvi d«i d-u (5.121) 

= j w(v',v -i | v,vi)f < '°\v 1 )f( 0) (v)g 2 (v) { 5 i(u)| du' dui d«i dw . 

It is valid for any two functions gq, g 2 ensuring existence of the integrals, and 
also using the first identity. 

Now, multiplying (5.117)-(5.120) by the microscopic moment density 
/i(u), performing integration over v (and using identities (5.120), (5.122)) 
we obtain the required transport equation for the scattering rate in the lin¬ 
ear neighborhood of the local equilibrium: 


-d t AM Q [(p,n] = -d t (ip,ii Q ) 

= (v k A k {v), hq({1 - P (0) )M«))) 

+d k (<p(v)v k ,- P (0) )/u(w))) + Jw(v’,v i | w,wi)/ (0) (wi)/ (0) (w) 
x ((1 - P (0) )/x(w)| A k (vi)(v lk - v k )ip(v) dv 1 dv[ dv^v 

+ (£(«), mq ((i-P (0) )MW)) • 


(5.122) 
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The chain of equations (5.122) for scattering rates is a counterpart of 
the hydrodynamic moment chain (5.100). Below we call (5.122) the second 
chain , and (5.100) - the first chain. Equations of the second chain are coupled 
in the same way as the first one: the last term in the right part of (5.91) 
(£, /j,q((1 — P(°}) fi)) depends on the whole totality of moments and scattering 
rates and may be treated as a new variable. Therefore, generally speaking, 
we have an infinite sequence of chains of increasingly higher orders. Only 
in the case of a special choice of the collision model - Maxwell potential 
U = —nr~ A - this sequence degenerates: the second and the higher-order 
chains are equivalent to the first (see below). 

Let us restrict our consideration to the first and second hydrodynamic 
chains. Then a deviation from the local equilibrium state and transition to 
a closed macroscopic description may be performed in three different ways 
for the microscopic moment density /jl(v). First, one can specify the moment 
M[/j] and perform a closure of the chain (5.100) by the triangle method given 
in previous subsections. This leads to Grad’s moment method. Second, one 
can specify scattering rate Mq [/jl\ and perform a closure of the second hydro- 
dynamic chain (5.91). Finally, one can consider simultaneously both M[/j] and 
Mq[/i] (mixed chain). Quasiequilibrium distribution functions corresponding 
to the last two variants will be constructed in the following subsection. The 
hard spheres model (H.S.) and Maxwell’s molecules (M.M.) will be consid¬ 
ered. 


5.6.4 Distribution Functions 

of the Second Quasiequilibrium Approximation 
for Scattering Rates 

First Five Moments and Collision Stress Tensor 

Elsewhere below the local equilibrium /(°)( 5.87) is chosen as the first quasi- 
equilibrium approximation. 

Let us choose = 771^^(5.89) as the microscopic density fi{v) of the 
second quasiequilibrium state. Let us write down the corresponding scattering 
rate (collision stress tensor) A^ in the form, 

Aik = 5 (5.123) 


where 


VQik(v) = m J w(v',v[ | vi,v)/ ( 0 ) (vi) 

x ((vi - Ui){v k - u k ) - ^6 ik (v - u) 2 1 d-i/di^ dt>i (5.124) 


is the microscopic density of the scattering rate A^. 
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The quasiequilibrium distribution function of the second quasiequilibrium 
approximation for fixed scattering rates (5.123) is determined as the solution 
to the problem 


(</?, (p) —> min for 

= Aik • (5.125) 

The method of Lagrange multipliers yields 

<p(v) = A ik VQik{v) , 

A ik(vQik,VQis) ~ Au , (5.126) 

where \k are the Lagrange multipliers. 

In the examples of collision models considered below (and in general, for 
centrally symmetric interactions) VQik is of the form 

VQik(v) = (i - P {0) )v ik (v)$({v - u ) 2 ) , (5.127) 

where (i — p(°))^ fc is determined by relationship (5.90) only, and function ^ 
depends only on the absolute value of the peculiar velocity (v — u). Then 

^ik ^Aik ? 

r -1 = (2/15) (<P 2 ((v - u) 2 ), (v - uf) , (5.128) 

and the distribution function of the second quasiequilibrium approximation 
for scattering rates (5.123) is given by the expression 


f = f(°\l + rA ik ^ Qik ) . (5.129) 

The form of the function ${(v — 'u) 2 ), and the value of the parameter r 
are determined by the model of particle’s interaction. In the Appendix to this 
example, they are found for hard spheres and Maxwell molecules models (see 
(5.187)-(5.192)). The distribution function (5.129) is given by the following 
expressions: 

For Maxwell molecules: 


/ = / (0) 

X jl + i^ L - M -m(2P 2 k B T)- 1 A ik ^(u* - Ui)(v k - u k ) 

m.m. _ k B T\/2rn 

^ 0 37rA 2 (5)'v/K ’ 


^ik(v - u) 2 ^ | , 

(5.130) 


where is viscosity coefficient in the first approximation of the Chapman- 

Enskog method (it is exact in the case of Maxwell molecules), k is a force 
constant, A.2(5) is a number, A.2(5) ~ 0.436 (see [TO]); 
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For the hard spheres model: 

/ = / (0) 

2y/2rmfiQ ,s - 


x < 1 + 


5 P 2 k B T 
m(v — u ) 2 


Mk 


f 1 f m(v - U ) 2 ol , 2\/i 

L exp {— + 


2k B T ^ “ y ) + 2 J d y (K ~ Ui)(v k - u k ) - -Sik{v - u)‘ 
M? S - = (5\ZkBT^)/(16Vna 2 ) , 
where f is a number represented as follows: 

f l = Y6 J ± J a ~ 11/2 P(y)P( z h(yh(z) 

x (16a 2 + 28a(7(y) + 7(2)) + 637(^7(2)) dy dz , 


(5.131) 


(5.132) 


a=l+y 2 + z 2 , 


P(y) = 1 + y 2 , i(y ) = i - v 2 • 


Numerical value of f -1 is 5.212, to third decimal point accuracy. 

In the mixed description, the distribution function of the second qua- 
siequilibrium approximation under fixed values of the moments and of the 
scattering rates corresponding to the microscopic density (5.89) is determined 
as a solution of the problem 


(ip, (f) —> min for (5.133) 

((i - r >(0) )^fe,^) = <?ik , 

{k'Qik, <p) = A ik ■ 

Taking into account the relation (5.127), we obtain the solution of the 
problem (5.133) in the form, 

ip(v) = (\ ik $((v -u) 2 ) + /3 ik ){{vi -Ui)(v k -u k ) - (l/3)6 ik (v -u) 2 ) . (5.134) 

Lagrange multipliers A i k , fii k are determined from the system of linear 
equations, 

ms~ 1 Xik + 2Pk B Tm~ 1 (3 ik = cr ik , 

mr^Xik + ms~ 1 f3 ik = A ik , (5.135) 

where 

s" 1 = (2/15)(<P((v - n) 2 ), (v - n) 4 ) . (5.136) 

If the solvability condition of the system (5.135) is satisfied, 

D = m 2 s~ 2 - 2Pk B Tr ~ 1 ^ 0 , (5.137) 

then the distribution function of the second quasiequilibrium approximation 
exists and takes the form 
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/ = /(°) {1 + (m 2 s -2 - 2Pk B Tr~ 1 )~ l (5.138) 

x[(ms~ 1 a ik - 2Pk B Tm~ 1 A ik )$((v - u ) 2 ) 

+ (ms -1 ~ mr~ 1 a ik )\((v i - Ui)(v k - u k ) - (1/3 )S ik (v - u) 2 )} . 

The condition (5.137) means independence of the set of moments from 
the scattering rates A If this condition is not satisfied, then the scattering 
rates A^ can be represented in the form of linear combinations of (with 
coefficients depending on the hydrodynamic moments). Then the closed by 
means of (5.129) equations of the second chain are equivalent to the ten 
moment Grad equations, while the mixed chain does not exist. This happens 
only in the case of Maxwell molecules. Indeed, in this case 

s" 1 = 2 P 2 k B T{m 2 iJif- M -)- 1 ] D = 0 . 

The transformation changing A^ to a\k is 

H^-AikP -1 = (T ik . (5.139) 


For hard spheres: 

w 5 "’ 5-1 ■ £ (£>+r w ) d » • 

(5.140) 

The numerical value of s~ x is 1.115 to third decimal point. The condition 
(5.136) takes the form, 



( P 2 k B T \ 


2 


o — 2 




(5.141) 


Consequently, for the hard spheres model the distribution function of the 
second quasiequilibrium approximation of the mixed chain exists and is de¬ 
termined by the expression 


/ = £ 0) {l + m(4:Pk B T(s 2 -f *)) 1 


&ik,S 


8\/2 


-i ov ^ H - s -ZL 


5 P 


Mo ^ik 


/: 


m(v — u ) 2 9 

exp| ~ 2fc B r y 


x (i — y 2 )(i + y 2 ) ^ ^ ~ y 2 ) + 2 ) d v 

+2 (s _1 • S 'Aik - f~ 1 a i k 


x((vi - Ui)(v k - u k ) 




(5.142) 
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First Five Moments, Collision Stress Tensor, 
and Collision Heat Flux Vector 

Distribution function of the second quasiequilibrium approximation which 
takes into account the collision heat flux vector Q is constructed in a similar 
way. The microscopic density £Qi is 

t,Qi( v ) = J w(v',v i | v,vi)/ ( 0 ) (vi) j(i - -P (0) )^| dv'dvidvi . 

(5.143) 

The desired distribution functions are the solutions to the following op¬ 
timization problems: for the second chain it is the solution to the problem 
(5.125) with the additional constraints, 


m{y,£,Qi) = Qi ■ (5.144) 

For the mixed chain, the distribution functions is the solution to the problem 
(5.133) with additional conditions, 


= Qi , (5.145) 

= (5.146) 

Here £$ == ViV 2 /2 (see (5.92)). In the Appendix functions £Qi are found 
for Maxwell molecules and hard spheres (see (5.192)-(5.197)). Since 

(£q*> VQkj) = ((i - VQkj) 

= (fo, (i - P (0) Hj) = ((i - P {0) )P, (i - P i0) Hj) = o, (5.147) 

the conditions (5.144) are linearly independent from the constraints of the 
problem (5.125), and the conditions (5.146) do not depend on the constraints 
of the problem (5.133). 

Distribution function of the second quasiequilibrium approximation of the 
second chain for fixed Z\^, Qi is of the form, 


/ = /(°)(1 + rA ik v Qik + riQiSoi) . (5.148) 


The parameter 77 is determined by the relation 

77- 1 = (1/3)(£qi,£q,) . 

According to (5.196), for Maxwell molecules 

_ 9to 3 (^' m -) 2 
V ~ 10. P 3 {k B T) 2 ’ 


(5.149) 


(5.150) 


and the distribution function (5.148) is 
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/ = / (0) 

X {l + n™ M -m(2P 2 k B T)~ 1 A ik ((vi - Ui)(v k - u k ) - (l/2>)5 ik {v - u ) 2 ) 
+ ^ M -m(P 2 k B T)- 1 (v i ~ ut) ^ ~ 1 ) } ' (5.151) 

For hard spheres (see Appendix) 


64 ra 3 (/iJ?- s -) 2 


(5.152) 


where r] is a number equal to 16.077 to third decimal point accuracy. 
The distribution function (5.148) for hard spheres takes the form 


(0) f 2 y/2rmi$- s - 

; ; I + 5 P 2 k B T lk 

m(v — u) 2 


L exp 


m(y — u ) 2 2 


2 k B T 


y P(vh(y) 


2k B T 

2V2r)m 3 M H.s. 

25 P 2 (fc B r) 


7(y) + 2^ dy (^ - Ui)(v k - U k ) - 1(5 ik (v - u)' 


2 *5* 


K - Mi) ((«-«) 


m(v — u) 2 2 


2k B T 
/*+! 


y 2 P(y)i(y) 


, _ 5&bT\ 
m / 

m(v — u) 2 




x L ex 

, .. . 2 /’ +1 / m(v - u) 2 2 \ 

+{vi - Ui){v -u) J 1 exp (- 2fcsT y J 

( . ,m(v - u) 2 _. A , 

x a (y) o;, ^ — + %) dy 


7 (y) + 2 dy 


y 2 ) 0(yh(y) 


2k B T 


(5.153) 


The functions (3(y),'y(y),cr(y) and S(y) are 
P(y) = l + y 2 , 7 (y) = l - y 2 , a{y) = y 2 { l - y 2 ), <5(y) = 3y 2 - l. (5.154) 


The condition of existence of the second quasiequilibrium approximation 
of the mixed chain (5.137) should be supplemented with the requirement 

R = m 2 T~ 2 - 5P( 0 fcsr) % - 1 / 0 . (5.155) 

2m 

Here 

t- 1 = 1 ((1 - P (0) )^Y^Qi(v)j . (5.156) 

For Maxwell molecules 

T” 1 = (5P 2 fc|T 2 ) / (3 ^' M 'to 3 ) , 


and the solvability condition (5.155) is not satisfied. Distribution function of 
the second quasiequilibrium approximation of mixed chain does not exist for 
Maxwell molecules. The variables Qi are changed to qi by the transformation 
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3 = 2P<li ■ 

For hard spheres, 

__i = = 25 (Pk B T) 2 

T T 8y2m 3 M H.s. ’ 

where 

f _1 = \J / 3_9/2 (yh(y){63(7(y) +a(y)) 

+?/%)( 4 - 107(y) + 2 5(y) - 5 a{y)) 

+P 2 (y) (257(2/) - 10 S(y) - 40) + 20/3 3 (y)} d y . 


(5.157) 

(5.158) 


(5.159) 


The numerical value of f 1 is about 4.322. Then the condition (5.155) is 
verified: 

R ^ 66m- A (Pk B T) 4 {/j^- s -) 2 . 

Finally, for the fixed values of < 7 ^, Z\^, qi and Qi the distribution function 
of the second quasiequilibrium approximation of the second chain for hard 
spheres is of the form, 


/ 


=/<°>{i- 


X 


X 


- (s~ 2 - 

4 Pk B T y 

1 ^ H.S .A 

Oik ^p Mo ^ik 

:/%>7 to )(=|-“' 2 


r'- 1 )” 1 




(v — u ) 2 \ 

k^ 1(, ) +2 ) l! 

1 


m(v — u) 2 9 \ 

2 k B T V ) 

“ f _1 , 


CTife 


X ((ll* - Ui)(Vfc - Wjk) - ^ife(w - m) 2 ^ 

,2 


m~ ( , 
" I "10(PA:bT) 2 ^ 

- Mi) ( (v 


x ((u 4 

V V' ' my 3-1 * v 

x/3(y)7 (y) 7 (y) + 2^ dy + (u, - Ui)(u - it) 2 

f +1 / m(w - m) 2 2 \ f m(v - u) 2 

- 2 I l r— ?/i 2 - 


~-i„ 4^/2 u.s. n ^ 

V ) I T Qi ^p Mo Qi I 

n2 5 k B T\ [ +1 ( m(y-u) 2 2 

u> - —)L 

u ) 2 \ 

-_— fy/l 1i\ _L 9 I rl 11 -L- (11 ■ — II \( 'll — II ^^ 


(5.160) 
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Thus, the expressions (5.130), (5.131), (5.142), (5.151), (5.153) and (5.160) 
give distribution functions of the second quasiequilibrium approximation of 
the second and mixed hydrodynamic chains for Maxwell molecules and hard 
spheres. They are analogues of ten- and thirteen-moment Grad approxima¬ 
tions (5.91), (5.95). 

The next step is to close the second and mixed hydrodynamic chains by 
means of the found distribution functions. 

5.6.5 Closure of the Second and Mixed Hydrodynamic Chains 
Second Chain, Maxwell Molecules 

The distribution function of the second quasiequilibrium approximation un¬ 
der fixed for Maxwell molecules (5.130) presents the simplest example of 
the closure of the first (5.99) and second (5.122) hydrodynamic chains. With 
the help of it, we obtain from (5.99) the following transport equations for the 
moments of the first (local equilibrium) approximation: 


dtP + di(v,ip) = 0 ; 

p{d t u k + UidiUk ) + dkP + d^P- 1 Pv mMm Aik) = 0 ; 

\{d t P + mdiP) + \pd iUi + A ik diU k = 0 . (5.161) 

Now, let us from the scattering rate transport chain (5.122) find an equation 
for A^ which closes the system (5.123). Substituting (5.130) into (5.122), we 
obtain after some computation: 


dtAi k T d s (u s Aik) T A is d s Uk T A ks d s Ui ^ikAi s d s ui 

^ikd s Us^ 

+P(ptf M -)- 1 A ik + A ik d s u s = 0 . (5.162) 

For comparison, let us give ten-moment Grad equations obtained when clos¬ 
ing the chain (5.99) by the distribution functions (5.91): 

d t p + di(uip) = 0 ; 

p(d t u k + UidiU k ) + d k P + di(7 ik = 0 ; 

^(<9 t P + uAP ) + ^PdiUi + cr ik diU k = 0 ; (5.163) 

d t cTi k + d s {u s (j ik ) + P (diU k + d k Ui - ^S ik d s u s 
2 

+a is d s u k + a ks d s Ui - -5 ik ai s d s ui + P(i^ M ')~ 1 ai k = 0 . (5.164) 


+P 2 (^- M ') 1 {diUk + d k Ui - | 
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Using the explicit form of (5.130), it is easy to verify that the trans¬ 

formation (5.139) maps the systems (5.161), (5.162) and (5.163) into one an¬ 
other. This is a consequence of the degeneration of the mixed hydrodynamic 
chain which was already discussed. The systems (5.161), (5.162) and (5.163) 
are essentially equivalent. These specific properties of Maxwell molecules re¬ 
sult from the fact that for them the microscopic densities (i — P^)viV k and 
(l-pW)viV 2 are eigen functions of the linearized collision integral. 


Second Chain, Hard Spheres 


We now turn our attention to the closure of the second and of the mixed 
hydrodynamic chains for the hard spheres model. Substituting the distribu¬ 
tion function (5.131) into (5.99) and (5.122), we obtain an analogue of the 
systems (5.161) and (5.162) (second chain, hard spheres): 


dtp + di(uip) = 0 ; 

p(d t u k + UidiU k ) + d k P + rs 


(5.165) 


-l ^a/2 ^ d-1 


d i (^-p- 1 A ik ) = 0; 


^(d t P + UidiP) + ^PdiUi + rs 1 • Sp 1 Akd i u k = 0; 

5£-i p 2 / 2 

^t^ik T dsi^s^ik) T T(l\(d S Us)^i k T jpg - y^i^k T O k Ui ~^ik^s^L< 


+r(a\ + cb) ( ^ is&s LLk + ^ks^sLLi ^^ik^ls^s^l 


+r(ai + o 3 ) ( A is d k u s + A ks diU s - 1 5 ik Ai s d s ui ) + (Pfa 0 /nf' S ')A ik = 0 


The dimensionless parameters ao, hi, a 2 and a% are determined by the quadra¬ 
tures 

~ ai= b r; /^(»)^(^ 7 2 w 7 (»)«- i 3 / 2 (y^) 

x{ 997 (y) 7 (z)( 7 ( 2 :) - 1 ) + 18a(y, z)(2^(z)(j(z) - 1 ) 
+ 4 7(y)( 4 7(^) -3)) + 8 a 2 (y, z) ( 47 ( 2 ) -3)}dyd2; 

«2 = j ^ j (3{y)f3(z)'y{y)'y 2 (z)a~ 11/2 (y,z){63'y{y)'y{z) 

+Ua(y,z)(3j(y) + 27 ( 2 :)) + 24a 2 (y, z)} dy dz ; 

& 3 ”It/j J 1 a _ 11 / 2 ( 2 /,^)/3(y)/3(2r)7(2/)7(^) 

x{ 637 (y) 7 (z)( 7 ( 2 :) - 1) + 14(27(2) (7(2) - 1) 

+l(y)(3l( z ) ~ 2 ))«(2 /> z ) + 8 a 2 (y, z){ 37 ( 2 ) - 2 )}dydz ; (5.166) 
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Q° - 153 g^/2 / 1 J l / 1 13/2 /3(^)/3 (y)P(z) 

x 1 { x )l{y)l(z) {10395 j(x)'y(y)'y(z) + 3780 <ip(x,y,z) 
x (7(^)7 (y) + l{x)l{z) + 7(2/)7(z)) + ISSOV’ 2 (x, y, z ) 
x ( 7 ( 2 ;) + 7 ( 2 /) + 7 ( 2 ;)) + 960 ip 3 (x, y , 2)} dx dy dz ; 

y, z) = 1 + x 2 + y 2 -\- z 2 . (5.167) 

Their numerical values are a\ ~ 0.36, d 2 ~ 5.59, a 3 ~ 0.38, do ~ 2.92 to 
second decimal point. 


Mixed Chain 

The closure of the mixed hydrodynamic chain with the functions (5.142) gives 
the following modification of the system of equations (5.166): 


dtp + difap) = 0 ; 

p(d t u k + UidiU k ) + d k P + di(Jik = 0 ; 

3 5 

~{d t P + uidiP) + -PdiUi + (J ik diU k = 0 ; 
dt&ik + d s {u s (Jik) + P f + d k Ui - ^ 5ikd s u & 


T ^is^s^k T &ksds'U j i ^bi k (Ji s O s Ui T ^i/c — 0 5 

5P 2 ( 2 

&t^ik T ^si^s^ik) T ~gy^2 H S T O k Ui ~^bi k d s U<. 


5 P 


— f 


d 


2 (ds'U's'jQtik 


1 / 2 

+ -(di + d 2 ) ( a is d s u k + a ks d s Ui - -S ik ai s d s ui 

T ds) T OL ks diu s —bi k Qti s d s ui 


+bi(d s U 8 )f3ik T (&1 T ^2) ( Pis^s^k T f^ks^s^i ^i k Pi s d s Ui 


+{bi T ^3) [ f3i s d k u s T (3 ks diU s ^ikftisds^i 


+ 


5P 2 


8 V 2 (/^- s -) 2 (s ~- 2 


-r- 1 ) { 


8\/2r 


+ OO a ik f — 0 


(5.168) 


C^ik — ^ 


8 ^ 

"5P" 


M «- s -A 


ik 


_ 1 8 a /2 u c . _ 1 

Pifc = s -gp- • Mo Afe - r a ik . 


(5.169) 
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It is clear from the analysis of distribution functions of the second quasiequi- 
librium approximations of the second hydrodynamic chain that in the Grad 
moment method the function <P(c 2 ) is substituted by a constant. Finally, let 
us note the simplest consequence of the variability of function <£(c 2 ). If /io 
is multiplied with a small parameter (Knudsen number Kn equal to the ra¬ 
tio of the main free path the to characteristic spatial scale of variations of 
hydrodynamic values), then the first with respect to Kn approximation of 
collision stress tensor has the form, 

A fk = p [di u k + d k Ui - ^ikdsV^j (5.170) 

for Maxwell molecules, and 

A fk = P + dkUi - ^SikdgU^j (5.171) 

for hard spheres. Substitution of these expressions into the momentum equa¬ 
tions results in the Navier-Stokes equations with effective viscosity coefficients 
Meff 5 

^ eff = (5.172) 

for Maxwell molecules and 

A*eff = ao Vo ' S ' (5.173) 

for hard spheres. When using ten-moment Grad approximation which does 
not distinguish Maxwell molecules and hard spheres, we obtain /i e ^ = /x^- s \ 
Some consequences of this fact are studied below in Sect. 5.7. 


5.6.6 Appendix: 

Formulas of the Second Quasiequilibrium Approximation 
of the Second and Mixed Hydrodynamic Chains 
for Maxwell Molecules and Hard Spheres 


Write isQik (5.124) in the standard form: 


VQik = f / (0) | V! | l (v, 

} (5.174) 

where b is the impact parameter, e is the angle between the plane containing 
the trajectory of the particle being scattered in the system of the center 
of mass and the plane containing the entering asymptote, the trajectory, 
and a certain fixed direction. It is convenient to switch to the dimensionless 
velocity c: 

m \ 1/2 

c, = i j ( v i ~ u i ) (5.175) 


- Ui){y k - u k ) - ^5 ik (v - u ) 2 


bdb de diq 
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and to the dimensionless relative velocity g: 



(5.176) 


After standard transformations and integration with respect to e (see [70]) 
we obtain in (5.174) 


3-P -1/2 

VQik = -7T / 

m 


jexp(-cl)ip¥\g) ^(cij - Ci)(ci k - c k ) - - c) : 


(5.177) 


dci 


Here 


4 2) = J i 1 - cos 2 x)\vi-v\ b(x) 


d b 




dx , 


(5.178) 


and x is an angle between the vectors g and g '. 

The dependence of J on the vector g is determined by the choice of the 
model of particle’s interaction. 

For Maxwell molecules, 




(5.179) 


where k is a force constant, A.2(5) is a number, A.2(5) ~ 0.436. 
For the model of hard spheres 


( 2 ) V2a 2 

<Pl = n 



I C 1 — C I , 


(5.180) 


where a is diameter of the sphere modelling the particle. 

Substituting (5.179) and (5.180) into (5.178), we transform the latter to 
the form: 

for Maxwell molecules 


3 P f 2k \ 1/2 . .. , 2 , 

T M 'M.(c 2 ) = J exp(— x 2 — 2xkCk)dx ; 


d d 
dc k 


1 

3 


dc s dc s J 


nM.M. 


(c 2 ); 


(5.181) 


for hard spheres 


VQik = 


Per 2 


k B T\ 1/2 2\ 

J exp(-c ) 


irm 


nH.S. 


2y/2 m 

(c 2 ) = J \ x \ exp(— x 2 — 2 XkCk) dx . 


2 ) ( d d 1 d d 
V dci dck 3 %k dc s dc s 


nH.S. 


(c 2 ); 


(5.182) 
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It is an easy matter to perform integration in (5.181), the integral is equal 
to t r 3 / 2 e c2 . 

Therefore for Maxwell molecules, 


3 (2k\ 12 ( 1 

VQik = 2 n7r ( — J ( (Vi - Ui)(v k - u k ) - -5ik(v - u)‘ 

The integral T H S ' in (5.182) can be transformed as follows: 

T h,s '(c 2 ) = 27t + 7T J exp(c 2 (l - y 2 ))c 2 (l + y 2 ) dy . 


(5.183) 


(5.184) 


Then for the model of hard spheres, 


k B T\ 3/2 

m J 


v Qik = V2nna 2 ( ] ( c . Cft _ i S ik c 2 


x J exp(—c 2 y 2 )(l + y 2 )(l — y 2 )(c 2 (l — y 2 ) + 2) dy . (5.185) 

Let us note a useful relationship: 

r+i 

d n T H - s -/d{c 2 ) n = TT exp(c 2 (l — y 2 )) 

x(l + y 2 ){l - y 2 )" _1 (c 2 (l - y 2 ) +n)dy,n > 1 . (5.186) 

Use the expressions for the viscosity coefficient /io which are obtained in 
the first approximation of the Chapman-Enskog method: 
for Maxwell molecules, 


^M.M. = (?™\ 


1/2 


for hard spheres, 


Mo S ’ = 


fc B r 

V K J 37Tx4 2 (5) 
5 (feTm) 1 / 2 


(5.187) 


(5.188) 


1§'k 1 / 2 <j 2 

Transformation of (5.183), (5.185) to the form of (5.127) gives the follow¬ 
ing functions @((v — u) 2 )\ 
for Maxwell molecules, 

<2> = P/nf M ' ; (5.189) 

for hard spheres 


<2> = 


5 P f +1 

wV^J-i exp 


m(v — u) 2 2 


2k B T 


y 


x (1 + y 2 )(l - y 2 ) ( m( ” fc “ )2 (1 - y 2 ) + 2 ) dy . 


(5.190) 
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The parameter r from (5.128) is: 
for Maxwell molecules: 


r = /(2P 3 k B T) ; 


for hard spheres: 

^64 

r — rp ___ L _ 

25 P 3 k B T ' 

The dimensionless parameter f is represented as follows: 

f l = Y6 J i J a *® 1/2 P(y)P( z h(vh( z ) 

x (16a 2 + 28a('j(y) + 7 (z)) + 637 ( 27 ) 7 ( 2 :)) dydz . 


(5.191) 


(5.192) 


(5.193) 


Here and below the following notations are used: 

P(y) = i + y 2 , 7 (y) = 1 ~y 2 , a = i + y 2 + z 2 . ( 5 . 194 ) 

Numerical value of f _1 is 5.212 to third decimal point. 

The parameter (5.136) is: 
for Maxwell molecules 


S - 1 = (2P 2 fc B T)/(m 2 ^' M ') ; 

for hard spheres 

— 15\/2P 2 k B T 

S S 8 mV?- s ' ' 

The dimensionless parameter s _1 is of the form 

s _1 = J ^ 7 (y)P~ 7/2 (y) (p{y) + ^ 7 00 d y . 

Numerical value of s -1 is 1.115 to third decimal point. 

The scattering rate density (5.143) is of the form, 


(5.195) 

(5.196) 


(5.197) 


^Qi = \/2 (0/) J / (0) (ui) | «i -v | jcj 0 2 -0| 6d6dedui . 

(5.198) 

Standard transformation of the expression {q(c 2 —5/2)} and integration 
with respect to e change (5.198) to the form, 

= 7 = [ exp(-c 2 )^J 2 ) (3(c 2 - c 2 )(c u - c») - (ci - c) 2 (c ai + c*)) dci . 

V27t m 7 

(5.199) 

Further, using the expressions (5.179) and (5.180) for we obtain: 
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for Maxwell molecules: 

= (~“) - 42 ( 5 ) exp (-c 2 ) DiT M - M -(c 2 ) ; (5.200) 

for hard spheres: 


s Qi = exp(-c 2 )Ar H - s -(c 2 ). 


(5.201) 


The operator Di is of the form 

1 d d d 3 d d 1 d d 

4 dci dc s dc s + 2 ° s dc s dci 2 ° l dc s dc s 

The operator Di acts on the function c 2 ) as follows: 


2 Q c - - + CiC 


d 2 ^ 

d(^y 


From (5.200), (5.201) we obtain: 
for Maxwell molecules: 


d 2 ^ d 3 ^ 


d(c 2 ) 2 d(c 2 ) 3 


%Qi = K - Ui) ( (V ~ U ) 2 - 




5 fc B T \ 

m ) ’ 


for hard spheres: 

5 P 


iQi = 


16^ s - 


(Vi - Ui) (u - u) - 


2 5 k B T\ 


m 




(5.202) 


(5.203) 


(5.204) 


(5.205) 


7 exp (" 


m(v — u) 2 2 


2k B T 
+(vi - u{)(v - u) 2 


y P(yh(y) 


m{v — u)' 


e lkv{T 


7 (y) + 2 }dy 


J ^ exp y 2 ^j P{y)i(y) ^(y) 


m(v — u )" 
2 /crT 


' %) d y 


The functions a(y),5(y) are of the form 

°(y) = y 2 (i - y 2 ), <5(y) = 3y 2 — 1 . 

The parameter 77 from (5.149) is: 
for Maxwell molecules: 


V = 


9m 3 (/i q 1 ' 1 ^’) 
10P 3 (/c b T ) 2 ’ 


(5.206) 


(5.207) 


for hard spheres: 
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~64 m 3 (/ i ^' S ') 2 
11 = ^ 125P 3 (fc B T) 2 ‘ 

The dimensionless parameter rj is of the form 


(5.208) 


v 1 = j l J l P(v)P( z h(y)i( z ) a 13/2 {Urt/G/bW + a (y) a ( z ) 

+ a{y)l(z) + v(zh(y)) + ^a(27(y) + 27(2) - 5 ~/(y)~/(z) 

+ 2 (cr(y) + a(z)) + 7 (z)S(y) + 7 (y)S(z) + a{y)5{z) + a(z)S(y)) 

7 25 

+ g“ 2 ( 4 - 107(2/) - 107 ( 7 )) + ~jl{y)l( z ) + 2 S(y) (5.209) 

+ 26(z) - 5 a(y) - 5 a(z) - ^( 7 (z)S(y) + y(y)S(z) + S(y)S(z)) 


+ -a 3 -20 


^(7 (v) + l{z)) - 5 (S(y) + 5(z))J + ^a 4 | 


dydz 


Numerical value of fj~ x is 0.622 to second decimal point. 

Finally, from (5.204), (5.206) we obtain r _1 (5.156): 
for Maxwell molecules 

_! = 5 (PfaT) 2 

for hard spheres 

_i = — 1 25P 2 (fe B T) 2 
8\Z2m 3 /u^- s - 

= \J P~ 9/2 (yh(y){^h(y) + a (y)) 

+ 7/3(y)(4 - 107 (y) + 25(y) - 5 a(y)) + 20 0 3 (y) 
+ 0 2 (y)(25j(y) - 10%) - 40)} dy « 4.322 . 


(5.210) 


(5.211) 


5.7 Example: Alternative Grad Equations 

and a “New Determination of Molecular Dimensions” 

(Revisited) 

Here we apply the method developed in the previous section to a classical 
problem: determination of molecular dimensions (as diameters of equivalent 
hard spheres) from experimental viscosity data. Scattering rates (moments 
of collision integral) are treated as new independent variables, and as an 
alternative to moments of the distribution function, to describe the rarefied 
gas near local equilibrium. A version of entropy maximum principle is used 
to derive the Grad-like description in terms of a finite number of scattering 
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rates. New equations are compared to the Grad moment system in the heat 
non-conductive case. Estimations for hard spheres demonstrate, in particular, 
some 10% excess of the viscosity coefficient resulting from the scattering 
rate description, as compared to the Grad moment estimation. All necessary 
details of the second chain formalism are explained below. 

The classical Grad moment method provides an approximate solution to 
the Boltzmann equation, and leads to a closed system of equations where 
hydrodynamic variables p, u, and P (density, mean flux, and pressure) are 
coupled to a finite set of non-hydro dynamic variables. The latter are usually 
the stress tensor a and the heat flux q constituting 10 and 13 moment Grad 
systems. The Grad method was originally introduced for diluted gases to 
describe regimes beyond the normal solutions [70], but later it was used, in 
particular, as a prototype of certain phenomenological schemes in nonequi- 
librium thermodynamics [235]. 

However, the moments do not constitute the unique system of non¬ 
hydrodynamic variables, and the exact dynamics might be equally expressed 
in terms of other infinite sets of variables (possibly, of a non-moment nature). 
Moreover, as long as one shortens the description to only a finite subset of 
variables, the advantage of the moment description above other systems is 
not obvious. As we have seen it above, the two sets of variables 

5.7.1 Nonlinear Functionals Instead of Moments 
in the Closure Problem 


Here we consider a new system of non-hydrodynamic variables, scattering 
rates M Q (f): 



(5.212) 



Hhhh = mv 


which, by definition, are the moments of the Boltzmann collision integral 





Here w is the probability density of a change of the velocities, ( v,vi ) —► 
(t/,^), of the two particles after their encounter, and w is defined by a 
model of pair interactions. The description in terms of the scattering rates 
Mq (5.212) is alternative to the usually treated description in terms of the 
moments M: M ili2 i 3 (f ) = / fi ili2 i 3 fdv. 

A reason to consider scattering rates instead of the moments is that Mq 
(5.212) reflect features of the interactions because of the w incorporated in 
their definition, while the moments do not. For this reason we can expect 
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that, in general, a description with a finite number of scattering rates will be 
more informative than a description provided by the same number of their 
moment counterparts. 

To come to the Grad-like equations in terms of the scattering rates, we 
have to complete the following two steps: 

(i) To derive a hierarchy of transport equations for p, u, P, and Mq i ± i 2 i 3 in 
a neighborhood of the local Maxwell states /o(p, n, P). 

(ii) To truncate this hierarchy, and to come to a closed set of equations with 
respect to p, n, P, and a finite number of scattering rates. 

In the step (i), we derive a description with infinite number of variables, 
which is formally equivalent both to the Boltzmann equation near the local 
equilibrium, and to the description with an infinite number of moments. The 
approximation comes into play in the step (ii) where we reduce the description 
to a finite number of variables. The difference between the moment and the 
alternative description occurs at this point. 

The program (i) and (ii) is similar to what is done in the Grad method 
[201], with the only exception (and this is important) that we should always 
use scattering rates as independent variables and not to expand them into 
series in moments. Consequently, we use a method of a closure in the step (ii) 
that does not refer to the moment expansions. Major steps of the computation 
will be presented below. 

5.7.2 Linearization 

To complete the step (i), we represent / as /o(l + <p), where /o is the local 
Maxwellian, and we linearize the scattering rates (5.212) with respect to <p: 



(5.213) 


AfJ'Qi 112*3 -^Q (^* 1 * 2*3 ) • 


Here Lq is the usual linearized collision integral, divided by /q. Though 
AMq are linear in <p, they are not moments because their microscopic den¬ 
sities, A/jlq , are not velocity polynomials for a general case of w. 

It is not difficult to derive the corresponding hierarchy of transport equa¬ 
tions for variables AMq qi 2 i 3 , p, n, and P (we refer further to this hierarchy 
as to the alternative chain): one has to calculate the time derivative of the 
scattering rates (5.212) due to the Boltzmann equation, in the linear approx¬ 
imation (5.213), and to complete the system with the five known balance 
equations for the hydrodynamic moments (scattering rates of the hydrody¬ 
namic moments are equal to zero due to conservation laws). The structure of 
the alternative chain is quite similar to that of the usual moment transport 
chain, and for this reason we do not reproduce it here (details of calculations 
can be found in [237]). One should only keep in mind that the stress tensor 
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and the heat flux vector in the balance equations for u and P are no more 
independent variables, and they are expressed in terms of AMq q^ 3 , p, u, 
and P. 


5.7.3 Truncating the Chain 

To truncate the alternative chain (step (ii)), we have, first, to choose a finite 
set of “essential” scattering rates (5.213), and, second, to obtain the distri¬ 
bution functions which depend parametrically only on p, u, P, and on the 
chosen set of scattering rates. We will restrict our consideration to a sin¬ 
gle non-hydrodynamic variable, ctq^, which is the counterpart of the stress 
tensor cr^-. This choice corresponds to the polynomial mViVj in the expres¬ 
sions (5.212) and (5.213), and the resulting equations will be alternative to 
the 10 moment Grad system 2 . For a spherically symmetric interaction, the 
expression for oq ij may be written: 


VQiiiv) = J Ap Qij f 0 <pdv ; (5.214) 

A^Qij = L Q (mViVj) = — T— SqIc 2 ) \c iCj - !<%c 2 1 . 

VQ o(-0 l <1 J 

Here t]qo(T) is the first Sonine polynomial approximation of the Chap- 
man-Enskog viscosity coefficient (VC) [70], and, as usual, c = y/^r ( v — 
u). The scalar dimensionless function Sq depends only on c 2 , and its form 
depends on the choice of interaction w. 


5.7.4 Entropy Maximization 

Next, we find the functions 


f*(p,u,P,a Qij ) = f 0 (p,u,P){l + ip*{p,u,P,a Qij )) 


which maximize the Boltzmann entropy S(f) in a neighborhood of /o (the 
quadratic approximation to the entropy is valid within the accuracy of our 
consideration), for fixed values of (JQiy That is, <p* is a solution to the fol¬ 
lowing conditional variational problem: 


AS(<p) 



max , 



ApQijfotpdv = a Qij ; 



foipdv = 0 . 


(5.215) 


2 To get the alternative to the 13 moment Grad equations, one should take into 
account the scattering counterpart of the heat flux, qQi = m f f) dv. 
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The second (homogeneous) condition in (5.215) reflects that a deviation ip 
from the state /o is due only to non-hydrodynamic degrees of freedom, and 
it is straightforwardly satisfied for (5.214). 

Notice, that if we turn to the usual moment description, then condition 
(i) in (5.215) would fix the stress tensor Oij instead of its scattering counter¬ 
part o-Qij. Then the resulting function /*(p, u, P, cr^) will be exactly the 10 
moment Grad approximation. It can be shown that a choice of any finite set 
of higher moments as the constraint (i) in (5.215) results in the corresponding 
Grad approximation. In that sense our method of constructing /* is a direct 
generalization of the Grad method onto the alternative description. 

The Lagrange multipliers method gives straightforwardly the solution to 
the problem (5.215). After the alternative chain is closed with the functions 
/*(p, u, P, gq ij ), the step (ii) is completed, and we arrive at a set of equations 
with respect to the variables p, tx, P, and GQij. Switching to the variables 
C ij = we have: 


(5.216) 

(5.217) 


d t n + di(nui) = 0 ; 




Here dt — d/dt,di = d/dxi , summation in two repeated indices is assumed, 
and the coefficients vq , (3q 1 and aQ are defined with the help of the function 
Sq (5.214) as follows: 



(5.220) 


The function Rq(c 2 ) in the last expression is defined due to the action of the 
operator Lq on the function SQ(c 2 )(ciCj — 1 5{jC 2 ): 


— RQ(c 2 )(ciCj - \6ijC 2 ) = L Q (S Q ((?)(ciCj - \5ijC 2 )) . (5.221) 

Vq o 3 6 
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Finally, the parameter yg in (5.216-5.220) reflects the temperature depen¬ 
dence of the VC: 




T 

Vqo( t ) 




The set of ten equations (5.216-5.220) is alternative to the 10 moment Grad 
equations. 


5.7.5 A New Determination of Molecular Dimensions (Revisited) 


The observation already made is that for Maxwell molecules we have: 
gM.M. = 2 , and ex: T; thus 7 M,M> = = 0, r M,M- = and 

(5.216-5.220) becomes the 10 moment Grad system under a simple change 
of variables AQj = og, where A is the proportionality coefficient in the tem¬ 
perature dependence of 77o d M ‘. 

These properties (the function Sq is a constant, and the VC is propor¬ 
tional to T ) are true only for Maxwell molecules. For all other interactions, 
the function Sq is not identical to one, and the VC tjqo(T) is not propor¬ 
tional to T. Thus, the shortened alternative description is not equivalent 
indeed to the Grad moment description. In particular, for hard spheres, the 
exact expression for the function S U ' S ' (5.214) reads: 

gH.s. _ f exp(—c 2 t 2 )(l — £ 4 ) (c 2 (l — t 2 ) + 2) dt ; (5.222) 

16 Jo 

77o H - S -oc VT . 

Thus, 7 H S - = A, and ^ H .s. ~ 0.07, and the equation for the function 
(5.220) contains a nonlinear term, 

0 u s Xikd s u s , (5.223) 


where # HS ‘ ~ 0.19. This term is missing in the Grad 10 moment equation. 

Finally, let us evaluate the VC which results from the alternative descrip¬ 
tion (5.216-5.220). Following Grad’s arguments [201], we see that, if the re¬ 
laxation of Qk is fast compared to the hydrodynamic variables, then the two 
last terms in the equation for Q/c (5.216-5.220) become dominant, and the 
equation for u casts into the standard Navier-Stokes form with an effective 
VC t\q e ff : 


V Qeff 


2 ^ W “ 


(5.224) 


For Maxwell molecules, we easily derive that the coefficient <ag in (5.224) 
is equal to Thus, as one expects, the effective VC (5.224) is equal to the 
Grad value, which, in turn, is equal to the exact value in the frames of the 
Chapman-Enskog method for this model. 
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Fig. 5.1. Approximations for hard spheres: bold line - function S H ' s ’, solid line - 
approximation S ^' s ', dotted line - Grad moment approximation 


For all interactions different from the Maxwell molecules, the VC ?7Q e ff 
(5.224) is not equal to t]qq. For hard spheres, in particular, a computation of 
the VC (5.224) requires information about the function R u s - (5.221). This 
is achieved upon a substitution of the function (5.222) into (5.221). 

Further, we have to compute the action of the operator L HS - on the function 
S R ' S '(ciCj — which is rather complicated. However, the VC ^ s - can 

be relatively easily estimated by using a function = ^(1 + ^c 2 ), instead 

of the function in (5.221). Indeed, the function is tangent to the 

function at c 2 = 0, and is its majorant (see Fig. 5.1). Substituting 
into (5.221), and computing the action of the collision integral, we find the 
approximation R^' S '; thereafter we evaluate the integral <a H S - (5.220), and 
finally come to the following expression: 

. (5.225) 

Thus, for hard spheres, the description in terms of scattering rates results 
in the VC of more than 10% higher than in the Grad moment description. 

A discussion of the results concerns the following two items. 

1. Having two not equivalent descriptions which were obtained within 
one method, we may ask: which is more relevant? A simple test is to com¬ 
pare characteristic times of an approach to hydrodynamic regime. We have 
tq ~ ? 7 o I S- /P for 10-moment description, and r a ~ rj^ /P for alternative 
description. As r a > tq, we see that scattering rate decay slower than corre¬ 
sponding moment, hence, at least for rigid spheres, the alternative description 
is more relevant. For Maxwell molecules both the descriptions are, of course, 
equivalent. 
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2. The VC (5.225) has the same temperature dependence as r] 

and also the same dependence on a scaling parameter (a diameter of the 
sphere). In the classical book [70] (pp. 228-229), “sizes” of molecules are 
presented, assuming that a molecule is represented with an equivalent sphere 
and VC is estimated as Since our estimation of VC differs only by a 

dimensionless factor from it is straightforward to conclude that effective 
sizes of molecules will be reduced by the factor 5, where 

b = ^- s V^ s - « 0.94 . 

Further, it is well known that sizes of molecules estimated via viscosity in [70] 
disagree with the estimation via the virial expansion of the equation of state. 
In particular, in book [238], p. 5, the measured second virial coefficient H exp 
was compared with the calculated Ho, in which the diameter of the sphere 
was taken from the viscosity data. The reduction of the diameter by factor b 
gives B e fi = b 3 Bo. The values H exp and Ho [238] are compared with B e ^ in 
the Table 5.1 for three gases at T = 500 K. The results for argon and helium 
are better for H e ff, while for nitrogen B e q is worth than Hq. However, both 
Bq and B e fi are far from the experimental values. 


Table 5.1. Three virial coefficients: experimental H exp , classical Bo [238], and 
reduced B e ^ for three gases at T — 500 K 



Hex p 

Bo 

H e ff 

Argon 

8.4 

60.9 

50.5 

Helium 

10.8 

21.9 

18.2 

Nitrogen 

168 

66.5 

55.2 


Hard spheres is, of course, an oversimplified model of interaction, and the 
comparison presented does not allow for a decision between and r]^ s \ 

However, this simple example illustrates to what extend the correction to the 
VC can affect a comparison with experiment. Indeed, as it is well known, 
the first-order Sonine polynomial computation for the Lennard-Jones (LJ) 
potential gives a very good fit of the temperature dependence of the VC for 
all noble gases [239], subject to a proper choice of the two unknown scaling 
parameters of the LJ potential 3 . We may expect that a dimensionless correc¬ 
tion of the VC for the LJ potential might be of the same order as above for 
rigid spheres. However, the functional character of the temperature depen¬ 
dence will not be affected, and a fit will be obtained subject to a different 
choice of the molecular parameters of the LJ potential. 

3 A comparison of molecular parameters of the LJ potential, as derived from the 
viscosity data, to those obtained from independent sources, can be found else¬ 
where, e.g. in [70], p. 237. 







6 Newton Method 

with Incomplete Linearization 


The Newton method with incomplete linearization is developed for solving 
the invariance equation. It is the basis of an iterative construction of the 
manifolds of slow motions. 


6.1 The Method 


Let us come back to the invariance equation (3.3), 

4 , = (1 - Py)AF(y)) = 0 . 


One of the most efficient methods to solve this equation is the New¬ 
ton method with incomplete linearization. Let us linearize the vector field J 
around F(y): 


J(F(y ) + SF(y)) = J(F(y)) + ( DJ) F(y) 6F(y ) + o(SF(y)) . (6.1) 


Equation of the Newton method with incomplete linearization makes it 
possible to determine SF(y) from a linear system: 



( 6 . 2 ) 


The crucial point here is that the same projector P y is used as in the 
equation (3.3), that is, the variation of the projector SP is not computed 
(hence, the suggested linearization of equation (3.3) is incomplete). We re¬ 
call that projector P y depends on the tangent space T y = im(DF) y . If the 
thermodynamic projector (5.25) is used here, then P y depends also on (|)f(i/) 
and on g = ( DS)p ( y )• 

Equations of the Newton method with incomplete linearization (6.2) are 
not differential equations in y anymore, they do not contain derivatives of the 
unknown SF(y) with respect to y (which would be the case if the variation of 
the projector SP has been taken into account). The absence of the derivatives 
in equation (6.2) significantly simplifies its solving. However, even this is not 
the main advantage of the incomplete linearization. More essential is the 
fact that iterations of the Newton method with incomplete linearization are 
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expected to converge to slow invariant manifolds, unlike the usual Newton 
method (with “complete linearization”). 

In order to clarify this feature of the Newton method with incomplete lin¬ 
earization (6.2), let us consider the case of linear manifolds for linear systems. 
Let a linear evolution equation be given in the real Hilbert space: 


x = Ax , 

where A is negative definite symmetric operator with a simple spectrum. The 
square of the norm is the Lyapunov function, 

S(x) = (x | x) . 

The manifolds we consider are lines, l(y) = ye, where e is the unit vector, 
and y is a scalar. The invariance equation for such manifolds reads: 

e(e | Ae) — Ae = 0 , 

and it is simply the eigenvalue problem for the operator A. Solutions to the 
latter equation are eigenvectors e$, corresponding to eigenvalues A*. 

Assume that we choose an initial approximation, that is the line Iq = ye o 
defined by the unit vector eo- Let the vector eo be not an eigenvector of A. We 
seek another line, li = ae i, where e\ is another unit vector, e\ = aq/||£Ci||, 
x\ = eo + Sx. The additional condition in (6.2) reads: P y SF(y ) = 0, i.e. 
(eo | Sx) = 0. Then (6.2) becomes 

[1 - e 0 (e 0 | -)]A[e 0 + Sx] = 0 . 

Subject to the additional condition, the unique solution is as follows: 
e 0 + Sx = (e 0 | A _1 e 0 ) _1 A _1 e 0 . 

Upon rewriting the latter expression in the eigen-basis of A, we have: 
e 0 + Sy oc^A- 1 ^ | e 0 ) . 

i 

The leading term in this sum corresponds to the eigenvalue with the mini¬ 
mal absolute value. The example indicates that the method (6.2) seeks the 
direction of the slowest relaxation. For this reason, the Newton method with 
incomplete linearization (6.2) can be recognized as the basis of iterative con¬ 
struction of the manifolds of slow motions. 

In an attempt to simplify computations, the question which always can be 
asked is as follows: To what extend is the choice of the projector essential in 
the equation (6.2)? This question is a valid one, because if we accept that it¬ 
erations converge to a relevant slow manifold, and also that the projection on 
the true invariant manifold is insensible to the choice of the projector, should 
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one care of the projector on each iteration? In particular, for the moment 
parameterizations, can one use in equation (6.2) the projector (5.1)? Experi¬ 
ence gained from some of the problems studied by this method indicates that 
this is possible. However, in order to derive physically meaningful equations 
of motion along the approximate slow manifolds, one has to use the ther¬ 
modynamic projector (5.25). Otherwise we cannot guarantee the dissipation 
properties of these equations of motion. 


6.2 Example: Two-Step Catalytic Reaction 

We consider here a two-step four-component reaction with one catalyst A 2 = 
Z (2.98): 

A\ A A 2 ^ A 3 ^ A 2 A A 4 . (5-3) 

We assume the Lyapunov function of the form (2.86), G = Ylt= 1 o[l n (o/c| q ) — 
1]. The kinetic equation for the four-component vector of concentrations, 
c = (c 1 , C 2 , C 3 , C 4 ), has the form 

c = 7 l W! A 7 2 H ?2 . (6.4) 


Here 7l 2 are stoichiometric vectors, 

= (-1,-1,1,0), 72 = (0,1,-1,1), (6.5) 

while functions Wi : 2 are reaction rates: 


W\ = kfcic 2 - £4 c 3 , W 2 = k 2 C3 - k 2 c 2 c 4 . ( 6 . 6 ) 

Here kf 2 are reaction rate constants. The system under consideration has 
two conservation laws, 

c i A C3 A C4 = Bi, C2 A C3 = B2 , ( 6 - 7 ) 

or ( 6 i } 2 , c) = Hi 25 where bi = (1, 0,1,1) and 62 = (0,1,1, 0). The nonlinear 
system (6.4) is effectively two-dimensional, and we consider one-dimensional 
manifolds of reduced description. 

We have chosen the concentration of the specie A\ as the variable of 
reduced description: M = c 1, and c\ = (m, c), where m = (1,0, 0,0). The 
initial manifold c = co(M) (i.e. c = co(ci, H 2 )) was taken as the quasi- 
equilibrium approximation, i.e. the vector function Co is the solution to the 
problem: 


G —> min for (m, c) = < 7 , ( 61 , c) = Hi, (b 2 , c) = H 2 . ( 6 . 8 ) 


The solution to the problem (6.8) can be computed explicitly: 
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Coi = Cl , (6.9) 

Co2 = B 2 - <P(ci) , 

C 03 = 0 (ci) , 

C04 = Bi — Cl — 0(ci) , 

0(M) = A(c i) - ^(ci)-^^! - Cl) , 
jB2(jBl _ c e q) + c e q(c e q + c e< 1 _ Ci) 

A(Cl) = -- ' 

The thermodynamic projector associated with the manifold (6.9) reads: 

P ° X = fc^ m,a: ' ) + + • (6-10) 

Computing = (1 — Po)J(co) we find that it is not equal to zero, and 
thus the quasiequilibrium manifold Co is not invariant. The first correction, 
Ci = Co + Sc, is found from the linear algebraic system (6.2) 

(1 - P 0 )L' 0 5c = -[1 - P 0 ]J(c 0 ) , (6.11) 

Sci = 0 
Sc\ + 8c% + Sc4 = 0 

Sc^ T <5c 2 = 0 , (6.12) 


where the symmetric 4x4 matrix L ' 0 has the form (we write 0 instead of Co 
in the subscript in order to simplify notations): 


_ _ W+ (co) + Wf (c 0 ) 711 . W 2 + (c 0 ) + W 2 -(c 0 ) 72/ 

^o,/cZ — 7ife 9 72 k 0 (6.13) 

^ Coz 2 Coz 

Here we use the self-adjoint linearization 1 . 

The explicit solution ci(ci, Hi, £> 2 ) to the linear system (6.11) is easily 
found, and we do not reproduce it here. The process was iterated. On the 
k-hl iteration, the following projector P^ was used: 


Pk*K 


dc k 

dci 


(m, x) 


dc k 

dB 1 


(bi,x) 


dc k 

dB 2 


(b 2 ,x) . 


(6.14) 


Note that projector P k (6.14) is thermodynamic only if k = 0. In the process 
of finding the corrections to the manifold, the non-thermodynamic projectors 
are allowed (we should return to the thermodynamic projector for projection 
of the vector field onto ansatz manifold). The linear equation at the k + 1 
iteration is thus obtained by replacing Co, Po 5 and L ' 0 with c k , P k , and L' k 
in all the entries of (6.11) and (6.13). 

1 The self-adjoint linearization was introduced in Chap. 2 (2.33), more detailed 
discussion follows in Chap. 7 (7.15) 
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Once the manifold c& was obtained on the kth iteration, we derived the 
corresponding dynamics by introducing the corresponding thermodynamic 
projector. The resulting dynamic equation for the variable c\ in the kth 
approximation has the form: 

(VG | ^dck/dafa = (VG | Ck ,J(c k )) . (6.15) 

Here [VG | C J< = In [c ki /c^]. 

Analytic results were compared with the results of the numerical integra¬ 
tion of the system (6.4). The following set of parameters was used: 

k+ = 1.0, fcf = 0.5, k+ = 0.4, k~ = 1.0 ; 
cf = 0.5, c q = 0.1, c q = 0.1, c 4 q = 0.4 , 

B x = 1.0, B 2 = 0.2 . 

Figure 6.1 demonstrates the quasi-equilibrium manifold (6.9) and the first 
two corrections. It should be stressed that we spent no special effort on the 
construction of the initial approximation, that is, of the quasi-equilibrium 
manifold, have not used any information about the Jacobian field (unlike, 
for example, the ILDM [93] or CSP [90] methods) etc. The initial quasi- 
equilibrium approximation is in a rather poor agreement with the reduced 
description. Therefore, it should be appreciated that the further corrections 



Fig. 6.1. Images of the initial quasi-equilibrium manifold (bold line) and the first 
two corrections (solid normal lines) in the phase plane [ci, C 3 ] for two-step catalytic 
reaction (6.3). Dashed lines are individual trajectories 
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rapidly improve the situation while no small parameter considerations were 
used. This confirms our expectation of the advantage of using the iteration 
methods instead of methods based on a small parameter expansions for model 
reduction problems. 

6.3 Example: Non-Perturbative Correction 
of Local Maxvellian Manifold 
and Derivation of Nonlinear Hydrodynamics 
from Boltzmann Equation (ID) 

We apply here the method of invariant manifold to a particularly impor¬ 
tant situation when the initial manifold consists of local Maxwellians (5.49) 
(the LM manifold). This manifold and its corrections play the central role in 
the problem of derivation of hydrodynamics from the Boltzmann equation. 
Hence, any method of approximate investigation of the Boltzmann equation 
should be tested with the LM manifold. Classical methods (the Chapman- 
Enskog and Hilbert methods) use Taylor-type expansions into powers of a 
small parameter (the Knudsen number expansion). However, as we have men¬ 
tioned above, the method of invariant manifold, generally speaking, assumes 
no small parameters, at least in its formal part where convergency properties 
are not discussed. We shall develop an appropriate technique to consider the 
invariance equation of the first iteration. This technique involves ideas of the 
parametrix expansion of the theory of pseudo differential and Fourier integral 
operators [249,250]. This approach will make it possible to avoid using small 
parameters. 

We seek a correction to the LM manifold in the form (dependence of 
velocity v will be not displayed whenever possible): 


fi(n,u,T) = fo(n,u,T) + 5fi(n,u,T) . 


(6.16) 


We use the Newton method with incomplete linearization for obtaining the 
correction 5/i(n, n, T), because we are interested in a manifold of slow (hy¬ 
drodynamic) motions. We introduce the representation: 


Sfi(n,u,T) = f 0 (n,u,T)ip(n,u,T) . 


(6.17) 


6.3.1 Positivity and Normalization 

When seeking corrections, we should be ready to face two problems that 
are typical for any method of successive approximations in the Boltzmann 
equation theory. Namely, the first of this problems is that the correction 


f^k + l f^k ^f&k+1 
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obtained from the linearized invariance equation of the k + 1-th iteration may 
be not a non-negatively defined function and thus it cannot be used directly in 
order to define the thermodynamic projector for the k + 1-th approximation. 
In order to overcome this difficulty, we can treat the procedure as a process 
of correcting the dual variable /if = DfH(f) rather than the process of 
immediate correcting the distribution functions. 

The dual variable /if is: 

= D f H(f)\ f=f{mtV) = D f HM)\ f=f(m , v) = h/(«,*) • (6-18) 


Then, at the k + 1-th iteration, we obtain a new dual variable /if 


i ’ 


^f\a k+1 ~ ^f\o k +S f J 'f\n k+1 • 


(6.19) 


Due to the relationship /if <—> /, we have: 

<wb fc+1 = v> ° k + 1 + = fnt S fnk +1 • (6.20) 


Thus, solving the linear invariance equation of the fc-th iteration with respect 
to the unknown function Sfs ? fc+1 , we find a correction to the dual variable 
ipn k+1 (6.20), and we derive the corrected distributions fn k+1 as 

fn k+1 = exp (v f | Qk + <pn k+1 ) = fn k exp(<pn k+1 ) . (6.21) 


Functions (6.21) are positive, and they satisfy the invariance equation and 
the additional conditions within the accuracy of (fn k+1 • 

However, the second difficulty which might occur is that functions (6.21) 
might have no finite moments (5.43). In particular, this difficulty can be a 
result of some approximations used in solving equations. Hence, we have to 
“regularize” the functions (6.21) in some way. A sketch of an approach to do 
this regularization is as follows: instead of fn k+1 (6.21), we consider functions: 


fn k+ i = ex P(^«k+i + ^(Z 3 )) • (6.22) 


Here (p reg (/3 ) is a function labeled with (3 G B, and B is a linear space. Then 
we derive f3* from the condition of matching the macroscopic variables. 

For example, corrections to the LM distribution in the Chap man-Enskog 
method [70] and the thirteen-moment Grad approximation [201] are not non- 
negatively defined functions, while the thirteen-moment quasiequilibrium ap¬ 
proximation [224] has no finite integrals (5.42) and (5.43). 


6.3.2 Galilean Invariance of Invariance Equation 

In some cases, it is convenient to consider the Boltzmann equation vector field 
in a reference system which moves with the flow velocity. In this reference 
system, we define the Boltzmann equation vector field as: 
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(6.23) 


Here u XtS (f) stands for the s-th component of the flow velocity: 


u x , s (f) =n x 1 (f) j vj(v,x)d 3 v, n x (f) = J f(v, x) d 3 u . 


(6.24) 


In particular, this form of the Boltzmann equation vector field is convenient 
when the initial manifold !?o consists of functions f^ 0 which depend explicitly 
on (v — u x (f)) (i.e.j if functions fn Q G Q o do not change under velocity shifts: 
v —> v + c, where c is a constant vector). This is also the case of the LM 
manifold. 

Substituting J u (f) (6.23) instead of J(f) (5.44) into all expressions which 
depend on the Boltzmann equation vector field, we transfer all procedures 
developed above into the moving reference system. In particular, we obtain 
the following invariance equation of the first iteration for a general locally 
finite dimensional initial approximation fo(a(x),v): 


( p at »)(•) - + A(fo(a(x),v)) = 0 ; (6.25) 


where 



A(f 0 (a(x),v)) = (P o * (<B) (0 - l)J u (fo(a(x),v)) . 


Here a{x ) are coordinates on the manifold at the given space point cc, P*^ 
is the corresponding thermodynamic projector. Additional conditions do not 
depend on the vector field, and thus they remain valid for equation (6.25). 

6.3.3 Equation of the First Iteration 

The equation of the first iteration in the form of (6.20) for the correction 
(p(n,u,T) is: 


{Pfo(n,u,T, 


')(■) l} \ ( V s u s ) 


dx s 


+ fo{n, u,T)Lf 0 ( ntUt T)(<p) 



(6.26) 
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Here Pf 0 ( n ,u,T) is the thermodynamic projector on the LM manifold and 
fo(n,u,T)Lf 0 ( njU , T )((p) is the linearized Boltzmann collision integral: 

fo(n,u,T)L fo{n ^ T) (ip) = j w(v' ,ui|v,u 1 )/o(n,u,T) 

x {tp 1 + (p[ — tpi — p} d 3 -i/ d 3 v , 1 d 3 vi . (6.27) 

Additional condition for equation (6.26) has the form: 

Pf 0 (n,u,T)(fo(n,u,T)(p) = 0 . (6.28) 

In detail notation: 


J 1 ■ f 0 {n,u,T)pd 3 v = 0, J Vif 0 {n,u,T)(pd 3 v = 0, 
J v 2 f 0 (n,u,T)<pd 3 v = 0 . 


i = 1,2,3, 


(6.29) 


Eliminating in (6.26) the terms containing 



n, u, T)p d 3 v and 



n, u, T)ipd 3 v 


with the use of (6.29), we obtain the following form of equation (6.26): 

df 0 (n,u,T) 


{Pfo(n,u,T){') 1 } ( K u s)' 


dx. 


(6.30) 


+ f 0 (n,u,T)L Mn ^ T) (p) - (v e - «») a(/ ° ( g“ ,r)y>) ) = 0 • 


In order to address the properties of equation (6.30), it proves useful to 
introduce real Hilbert spaces G/ 0 ( n>iX> T) with scalar products: 


(<f, ^)fo(n,u,T) = J fo(n, U, T)<pip d 3 v . (6.31) 

Each Hilbert space is associated with the corresponding LM distribution 
fo(n,u,T). 

The projector Pf 0 ( n , u ,T) (5.55) is associated with a projector Ptf 0 ( n ,u,T) 
which acts in the space G/^n^T): 

nf 0 (n, U ,T){v) = /o" 1 ( n > u > T )- P /o(n,'u,T)(/o(n,M,r)vj) . (6.32) 


It is an orthogonal projector, because 

4 

Hfo(n,u,T){<P) = ^ ^n(n.u.T)i^fn(n.u.T)i <P) fo(n,u,T) ■ 
s=0 


(6.33) 
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Here V’/o (n, u are given by the expression (5.57). 

We can rewrite the equation of the first iteration (6.30) in the form: 

-Lfo(n,u,T) i}P) T Kf 0 (n,u,T) (p) = ^fo(n,u,T) • (6.34) 

Notations used here are: 

Df 0 ( n ,u,T) = fo 1 {n,u,T)A(f 0 (n,u,T)) ; (6.35) 

K Mn , UtT) (<p) = {JT /o(n , u , T) (-) - 1} fo\n,u,T)(v s - u s ) WgdM . 

The additional condition for equation (6.34) is: 

(^/o \n,u,T) ’ fo(n,u,T) = 0, S = 0, . . . , 4 . (6.36) 

We list now the properties of the equation (6.34) for usual collision 
models [70]: 

(a) The linear integral operator T/ 0 ( n? -u,T) is self-adjoint with respect to the 
scalar product (•, *)/ 0 (n,u,T)> and the quadratic form (<^, T/ 0 ( n , n 5 T) (</?)) is 
negatively definite in imLf 0 ^ n u T y 

(b) The kernel of Lf Q t n , u ,T) does not depend on /o(n, u, T), and it is the 

linear hull of the polynomials = 1, = Vi,i = 1,2,3, and ?/q = v 2 . 

(c) The right hand side T>/ 0 ( n ,tA,T) is orthogonal to kerTj 0 ( n in the sense 
of the scalar product (•, -)/ 0 (n,n,T)- 

(d) The projection operator 7I/ 0 ( n ,rt,T) is the self-adjoint projector onto 

kerTjo ( n ,u,T) ‘ 

Hfo(n,u,T)(<p) £ kerTj 0 ( n ^ jT ) (6.37) 

Projector 77j 0 ( n?n?T ) projects orthogonally. 

(e) The image of the operator i^/ 0 (n 5l t,T) is orthogonal to kerTj 0 ( n ^ t)- 

(f) Additional condition (6.36) requires the solution of equation (6.34) to be 
orthogonal to kerLj 0 ( n?n?T ). 

These properties result in the necessary condition for solving the equation 

(6.34) with the additional constraint (6.36). This means the following: equa¬ 
tion (6.34), provided with constraint (6.36), satisfies the condition which is 
necessary to have the unique solution in imLf Q r n ^ u T y 

Remark. Because of the differential part of the operator -K/ 0 ( n ,u,T)> we are 
not able to apply the Fredholm alternative to obtain the necessary and suf¬ 
ficient conditions for solvability of equation (6.36). Thus, the condition men¬ 
tioned here is, rigorously speaking, only the necessary condition. Neverthe¬ 
less, we shall continue to develop a formal procedure for solving the equation 

(6.34) . 

To this end, we paid no attention to the dependence of functions, spaces, 
operators, etc, on the space variable x. It is useful to rewrite once again 
the equation (6.34) in order to separate the local in x operators from the 
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differential operators. Furthermore, we shall replace the subscript /o(n, tx, T) 
with the subscript x in all the expressions. We represent (6.34) as: 


Ai oc (x,v)(f ^4diff Qx ’ ^J ^ — D(x,v') , 

A\oc(x, v)if = - {L x (y)ip + (n x (v) - 1 )r x (f} ; 
^diff (x, V = (^*(0 “ x ) 


n x (v)g = y]vi s) (V4 s) >3); 


s=0 


Vi 0) = n _1/2 , V47 = (2/n) 1/2 c s (*,v), s = 1,2,3 , 

V4 4) = (2/3n) 1/2 (c 2 (a:, v) - 3/2); c»(aj,«) = ( m/2k B T(x)) 1/2 (vi - u»(aj)) 

3\ <91nT\ 

sTT; ; 


/ x /cdnn m . x dui (m(v — u ) 2 

r * = (v 8 - «,) - «<) + 


knT 


dx s 


2k H T 


D(x,v) = 




■u) 2 5\ ,<91nT 

2fc s T 2 ) ^ Vi ~ Uj ‘ > ~dx^ 


IcbT («”< - - “■> - - “> 2 ) £) 


(6.38) 


Here we have omitted the dependence on x in the functions n(x), Ui(x ), and 
T(x). Further, if no confusion might occur, we always assume this depen¬ 
dence, and we shall not indicate it explicitly. 

The additional condition for this equation is: 


n x (<p) = 0. (6.39) 

Equation (6.38) is linear in <p. However, the main difficulty in solving this 
equation is caused by the differential in x operator Mdiff which does not 
commute with the local in x operator A\ oc . 


6.3.4 Parametrix Expansion 


In this subsection we introduce a method to construct approximate solu¬ 
tions of equation (6.37). This procedure involves an expansion similar to the 
parametrix expansion in the theory of pseudo-differential (PDO) and Fourier 
integral operators (FIO). 

Considering ip E imL x , we write a formal solution of equation (6.38) as: 


ifi(x,v) 


^4ioc(iC,u) ^diff 



(~D(x,v)) 


(6.40) 


It is useful to extract the differential operator ^ from the operator 

~q^. i ^) ; 
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<p(x,v) = B s (x,v)-j^-J <pioc(x,v) . (6.41) 

Notations used here are: 

<P\oc(x,v) = A{ 0 1 c (x,v)(-D(x,v)) 

= [~L x (v) - (n x (v) - l)r x ] _1 (~D(x, v)) ; 

B 3 (x,v) = A^(x,v)(n a (v) - l)(u a -u s ) (6.42) 

= [~L x (v) - (II x (v) - l)r x ] _1 (I7 x (u) - l)(v s - u s ) . 

We shall now discuss in more details the properties of the terms in (6.42). 
For every x, the function ip\ oc (x, v), considered as a function of v, is an 
element of the Hilbert space G x . It gives a solution to the integral equation: 

- L x (v)tf ioc - (II x (v) - l)(r x ifi oc ) = (~D(x, v)) (6.43) 

This latter linear integral equation has the unique solution in im L x (v). In¬ 
deed, 


ker^ 1 + c (®,u) = ker (L x (v) + (II x (v) - 1 )r x ) + 

= ker(i a .(u)) + P|ker((I7 a .(u) - l)r x )* 

= ker(i a! (u)) + P|ker(r a! (I7 a .(u) - 1)) , 


and G x Q n x {v)G x = {0} . (6.44) 


Thus, the existence of the unique solution of equation (6.43) follows from the 
Fredholm alternative. 

Let us consider the operator R(x , v): 


R l x 'iL’ v ) = \ 1 - B ‘ ix ’ v) £; 


One can represent it as a formal series: 


d 




m =0 L 


B s ( x , v) 

ox s 


Here 


B s (x,v) — 
dx. 


d d 

= B Sl (x, v) —- ...B Sm (x, v) - 


dx„ 


(6.45) 


(6.46) 


(6.47) 


Every term of the type (6.47) can be represented as a finite sum of operators 
which are superpositions of the following two operations: of the integral in v 
operations with kernels depending on cc, and of differential in x operations. 
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Our goal is to obtain explicit representation of the operator R(x, v) 
(6.45) as an integral operator. If the operator B s (x,v) would not depend 
on x i.e., if no dependence on spatial variables would occur in kernels of 
integral operators, in B s (x,v)), then we could reach our goal via the usual 
Fourier transform. However, operators B s (x, v) and do not commute, and 
thus this elementary approach does not work. We shall develop a method to 
obtain the required explicit representation using the ideas of PDO and IOF 
technique. 

We start with the representation (6.46). Our strategy is to transform every 
summand (6.47) in order to place integral in v operators B s ( x . v) on the left 
of the differential operators . The commutation of every pair B s ( x , v) 

yields an elementary transform: 


d 

dx k 


B s ( x,v) 


B s (x,v) 


d 

dx k 


B s {x,v) 


d 

’ dx k 


(6.48) 


Here [M,N] = MN — NM denotes the commutator of operators M and N. 
We can represent (6.47) as: 


B s (x,v) — 
ox s 


= B Sl (x,v)...B Sm (x,v) 


dx s 


dx s 


+0 


B Si (x,v), 


d 


dx. 


(6.49) 


Here 0([B Si (x,v), q^—\) denotes the terms which contain one or more pairs 
of brackets [•,•]. The first term in (6.49) contains no brackets. We can continue 
this process of selection and extract the first-order in the number of pairs of 
brackets terms, the second-order terms, etc. Thus, we arrive at the expansion 
into powers of commutator of the expressions (6.47). 

In this section we consider explicitly the zeroth-order term of this commu¬ 
tator expansion. Neglecting all the terms with brackets in (6.49), we write: 


r\ r\ 

= B Sl (x,v).. .B Sm {x,v)-^ — . (6.50) 

Here the subscript zero indicates the zeroth order with respect to the number 
of brackets. 

We should now substitute expressions [B s (x, (6.50) instead of 

expressions [B s (x, ^)^f-] m (6.47) into the series (6.46): 




Ro 



E 

m =0 


B s {x , v ) 


d -i rr 

dx s \ 0 


(6.51) 


The action of every summand (6.50) might be defined via the Fourier trans¬ 
form with respect to spatial variables. 

















152 6 Newton Method with Incomplete Linearization 


Denote as F the direct Fourier transform of a function g(x,v)\ 


Fg(x,v) = g(k,v) = J g(x,v)exp(-ik s x s )d p x . (6.52) 

Here p is the spatial dimension. Then the inverse Fourier transform is: 

g[x, v) = F _1 g(fc, v) = {‘2tt)~ p J g(k , v) exp (ik s x s ) d p k . (6.53) 

The action of the operator (6.50) on a function g(x,v) is defined as: 

-i m 


d 

B s (x,v) — 
ox. 


g(x,v) 


0 


= B ai (x,v)... B Sm (x,v) 


dx Sl ’ ’ ’ dx s 


(2 tt)-p f g(k,v)e iksX ‘d p k 

= ( 2 ir)~ p J exp(ik s x s )[ikiBi(x, v)] m g(k, v) d p k . (6.54) 

Taking into account (6.54) in (6.51) yields the following definition of the 
operator Rq: 

R 0 g(x,v) = ( 2 w)~ p J e lksXs (l - ikiBi(x,v))~ 1 g(k,v)d p k . (6.55) 


This is the Fourier integral operator (note that the kernel of this integral 
operator depends on k and on x). The commutator expansion introduced 
above is a version of the parametrix expansion [249,250], while expression 
(6.55) is the leading term of this expansion. The kernel (1 — ikiBi(x , v)) -1 is 
called the main symbol of the parametrix. 

The account of (6.55) in the formula (6.41) yields the zeroth-order term 
of parametrix expansion <p 0 (a5,u): 

tp 0 (x, v ) = F -1 (l - ik t Bi(x, v))~ 1 Ftp\ oc . (6.56) 


In detail notation: 


<Po(x,v) 



-Vs)) 


X(1 - ik s [-L x (v) - (n x (v) - l)r x ] 1 (II x (v) - l)(v 8 - u s {x))) 1 
x[-L y (v) - (n v (v) - l)r y ]~ 1 (—D(y, v)) d p y d p k . (6.57) 


We shall now list the steps to calculate the function (fo(x,v) (6.57). 
Step 1. Solve the linear integral equation 


[~L x (v) - (n x (v) - 1 )r x \(pi oc (x, v ) = -D(x, v ) . (6.58) 


and obtain the function p\ oc (x,v). 
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Step 2. Calculate the Fourier transform cp\ oc (k,v): 


<pioc(k, v) = J </?ioc(y, v) exp (~ik s y s ) d p y . (6.59) 

Step 3. Solve the linear integral equation 

[-L x (v) - (JI x {v) - 1 ){r x + ik s (v s - u s (x))](p 0 (x, k , v) = -D(x, k , v) ; 
-D(x,k,v) = \-L x {v) - (II x (v) - 1 )r x \(p\oc(k,v) . (6.60) 


and obtain the function fio (as, fe, u). 

Step 4. Calculate the inverse Fourier transform ipo(x,v): 

ipo(x^v) = J (fo(x, v) exp(ik s x s ) d p k . (6.61) 

Completing these four steps, we obtain an explicit expression for the zeroth- 
order term of parametrix expansion ipo(x, , u)(6.56). 

As we have already mentioned it above, equation (6.58) of Step 1 has the 
unique solution in im L x (v). Equation (6.60) of Step 3 has the same property. 
Indeed, for every k , the right hand side —D(x, k , v) is orthogonal to im JI x (v), 
and thus the existence and the uniqueness of the formal solution (fo(x , k , v) 
follows again from the Fredholm alternative. 

Thus, in Step 3, we obtain the unique solution <p Q (x,k,v). For every /c, 
this is a function which belongs to im L x (v). Because the LM distribution 
fo(x,v) = fo(n(x),u(x),T(x),v) has no explicit dependency on cc, we see 
that the inverse Fourier transform of Step 4 gives ipo(x,v) G im L x (v). 

Equations (6.58)-(6.61) provide us with the scheme of constructing the 
zeroth-order term of parametrix expansion. Closing this section, we outline 
briefly the way to calculate the first-order term of this expansion. 

Consider a formal operator R = (1 — AB)~ X . Operator R is defined by a 
formal series: 

oo 

R=^ 2 {AB) m . (6.62) 

m =0 

In every term of this series, we want to place operators A on the left to 
operators B. In order to do this, we have to commute B with A from left to 
right. The commutation of every pair BA yields the elementary transform, 
BA —> AB — [A, B\, where [A, B] = AB — BA. Extracting the terms with no 
commutators [A, B] and with a single commutator [A, B], we arrive at the 
following representation: 


R = Rq + R\ + (terms with more than two brackets) . (6.63) 


Here 
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oo 


R 0 = J2 A m B m 


(6.64) 


m =0 


oo oo 


R 1 = -'22 ^ j iA m - i [A,B}A i - 1 B i - 1 B m 


(6.65) 


Operator Rq (6.64) is the zeroth-order term of parametrix expansion derived 
above. Operator R\ (the first-order term of parametrix expansion ) can be 
represented as follows: 



C=[A,B]Rq . 


( 6 . 66 ) 


This expression can be considered as an ansatz for the formal series (6.62), 
and it gives the most convenient way to calculate R\. Its structure is similar 
to that of Rq. Continuing in this manner, we can derive the second-order 
term i? 2 , etc. 

In the next subsection we shall consider in more detail the zero-order term 
of parametrix expansion. 

6.3.5 Finite-Dimensional Approximations 
to Integral Equations 

Dealing further only with the zeroth-order term of parametrix expansion 
(6.57), we have to solve two linear integral equations, (6.58) and (6.60). These 
equations satisfy the Fredholm alternative, and thus they have unique solu¬ 
tions. After the problem is reduced to solving linear integral equations, we 
are at the same level of complexity as in the Chap man-Enskog method. The 
usual approach is to replace integral operators with some appropriate finite¬ 
dimensional operators. 

First we remind some standard objectives of finite-dimensional approxi¬ 
mations, considering equation (6.58). Let Pi(x,v ), where i = 1,2,..., be a 
basis in im L x (v). Every function ip(x,v) G im L x (v) can be represented in 
this basis as: 


oo 



(6.67) 


Equation (6.58) is equivalent to an infinite set of linear algebraic equations 
with respect to unknowns cq(cc): 


oo 



i=1 


( 6 . 68 ) 
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Here 


m ki (x) = (p k (x,v),Ai oc (x,v)pi(x,v)) x ; 

d k {x) = -( p k (x , v), D(x, v)) x . (6.69) 

For a finite-dimensional approximation of equation (6.68) we use a projection 
onto a finite number of basis functions Pi(x , v),i = ii,...,i n . Then, instead 
of (6.67), we search for the function (p^ n : 

n 

<pa n (x,v) = '^2a is (x)p is (x,v) . (6.70) 

S=1 

Infinite set of equations (6.68) is replaced with a finite set of linear algebraic 
equations with respect to ai s (as), where s = 1,..., n: 

n 

^m is i l (x)a il (x) = d is (x), s = l,...,n. (6.71) 

1=1 

There are no a priori restrictions upon the choice of the basis, as well as upon 
the choice of its finite-dimensional approximations. Here we use the standard 
basis of irreducible Hermite tensors (see, for example, [112,201]). The simplest 
finite-dimensional approximation occurs if the finite set of Hermite tensors is 
chosen as: 

Pk{x,v) = c k (x,v)(c 2 (x,v ) - (5/2 )),k = 1,2,3; 

Pij(x,v ) = a{x,v)cj(x,v) - -SijC 2 (x,v), i,j = 1,2,3 ; 

C{(x,v) = v^, 1 (x)(vi — Ui(x)), vt{x) = (2 kBT(x)/m) 1 ^ 2 . (6.72) 

It is important to stress here that “good” properties of orthogonality of Her¬ 
mite tensors, as well as of other similar polynomial systems in the Boltzmann 
equation theory, have the local in x character, i.e. when these functions are 
treated as polynomials in c(x, v ) rather than polynomials in v. For example, 
functions p k (x, v) and pij(x , v)(6.72) are orthogonal in the sense of the scalar 
product (■, -) x : 


(Pk(x,v),pij(x,v)) x oc J e ° 2( ' x ’ v ' l p k (x,v)pi j (x,v)d 3 c(x,v) = 0 . (6.73) 

On the contrary, functions Pk{y,v) and pij(x,v ) are not orthogonal neither 
in the sense of the scalar product nor i n the sense of the scalar product 

(■, ’)s®, if JJ ^ x. This distinction is important for constructing the parametrix 
expansion. Further, we omit the dependencies on x and v in the dimensionless 
velocity Ci(x,v)(6. 72) if no confusion might occur. 

In this section we consider the case of one-dimensional in x equations. 
We assume that: 
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ui(x) = u(x i) , u 2 = ^3 = 0 , T(x) = T(x i), n(x) = n(aq) . (6.74) 

We write x instead of x\ below. Finite-dimensional approximation (6.72) 
requires only two functions: 



We shall now perform a step-by-step calculation of the zeroth-order term 
of the parametrix expansion, in the one-dimensional case, for the finite¬ 
dimensional approximation (6.75). 

Step 1 . Calculation of (p\ oc (x,v) from equation (6.58). 

We seek the function <fi\ oc (x,v ) in the approximation (6.75) as: 


<P\oc{x, v) = ai oc (x)(cl - (1/3)c 2 ) + b\ oc (x)ci(c 2 - (5/2)) . (6.76) 


Finite-dimensional approximation (6.71) of integral equation (6.58) in the 
basis (6.75) yields: 


mz 2 ,(x)a\ oc (x) + m M (x)bi oc (x) = ai oc (x) ; 

^ 43 (^)^ioc(^) + rn 4 4 (x)bi oc (x) = (h oc (x) . (6.77) 


Notations used are: 



(6.78) 


Parameters Xs(x) and X^x) are easily expressed via the so-called Enskog 
integral brackets, and they are calculated in [70] for a wide class of molecular 
models. 

Solving equation (6.77), we obtain coefficients a\ oc (x) and b\ oc (x) in the 
expression (6.76): 



Z(x, 0) = m 33 (x)m 4 4 (x) - m% 4 (x) ; 


A\oc(x) = a loc (x)m, 4 4 {x) - /3\ oc (x)m M (x) ; 
Bioc(x) = Pi 0 c(x)m 33 (x) - a\ oc (x)m 34 (x) ; 



^nA 4 + 
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5 din T f 11 du\ 2 du ( dlnn lldlnT\ 

-7^T—^+ — 7^ + ~Vt^— ( —x-h 


^loc — 


dx 


9 dx J 9 dx 


dx 


2 dx 


11 drA ( . 21 du\ v% (dlnn 11 din TV 

“^17 H + Tte -f 


x / 


(6.79) 

These expressions complete Step 1. 

Step 2 . Calculation of Fourier transform of ipi oc (x,v) and its expression 
in the local basis. 

In this step we make two operations: 

(i) The Fourier transformation of the function (p\ oc (x,v): 

p-\-oo 

(6.80) 


/ -+- oo 

exp(-iky)<pi oc (y,v)dy 

-OO 


(ii) The representation of f>\ oc (k, v ) in the local basis {po(x, v),... ,p±(x, v)}: 

Po(x, v) = l,pi(x, v)=c 1 (x,v),p 2 (x,v)=c 2 (x,v) - (3/2) , (6.81) 

p 3 (x,v)=c\{x,v) - (l/3)c 2 (x,v),p 4 (x,v)=c 1 (x,v)(c 2 (x,v) - (5/2)) . 

Operation (ii) is necessary for completing Step 3 because there we deal 
with ^-dependent operators. Obviously, the function (p\ oc (k,v ) (6.80) is 
a finite-order polynomial in v, and thus representation (ii) is exact. 

We obtain in (ii): 

4 

<p loc (x,k,v) = <pi oc (x,k,c(x,v)) = ^ ^hj(x,k)pi(x,v) . 


i =0 


Here 


hi(x,k ) = (pi(x,v),pi(x,v)) x 2 (tp loc (k,v),pi(x,v)) x . 

Let us introduce notations: 

$ = &(x, y) = (T(x)/T(y)) 1/2 , 7 = 7 (x, y) = ■ 

Coefficients hi(x, k)(6.83) have the following explicit form: 

/ + OO 

exp(-iky)hi(x,y) dy, hi{x,y) = Z~ 1 (y,0)g i (x,y) 

-OO 

9 o(x,y) = .Bioc(y)(7 3 + ^7(^ 2 - 1 )) + ^ioc(y)7 2 ; 

9 i(x,y) = Bi oc (y)(39j 2 + - 1)) + |Ai oc (y)i ?7 ; 

5 

92(x,y) = ^B loc (y)d 2 -y ; 

9 z{x,y) = -Bi oc (y) 2$7 + Ai oc (y)d 2 ; 

94 ,(x,y) = B loc (y)ti 3 . 


(6.82) 

(6.83) 

(6.84) 


(6.85) 
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Here Z(y,ti),B\ oc (y) and A\ oc (y) are the functions defined in (6.79) 

Step 3. Calculation of the function f>o(x, k , v) from equation (6.60). 
Linear integral equation (6.60) is similar to equation (6.58). We search 
for the function (po(x,k,v) in the basis (6.75) as: 


<Po(x, k, v ) = d 0 (£, k)p 3 (x, v ) + b 0 (x, k)p±(x, v ) . 


( 6 . 86 ) 


Finite-dimensional approximation of the integral equation (6.60) in the basis 
(6.75) yields the following equations for unknowns do(x,k) and bo(x,k): 


m 33 (x)d 0 (x,k) 


1 


m 34 (x) + -ikvr(x) 


m 43 (x) + - ikv T (x ) 


Notations used here are: 


bo(x,k) = a 0 (x,k) ; 
do(x, k) + m 44 (x)b 3 (x, k) = j3o(x, k) 


&o(x, k) = m 33 {x)h 3 {x , k) + m 34 (x)h 4 (x , k) + s a (x, k) 
$q{x, k) = m 43 (x)h 3 (x , fc) + m44(x)/i4(x, fc) + s^(x, fc) 

/ + CXD 

exp {-iky)s a fi{x,y) d y ; 

- OO 

/ \ 1 / \ (dlnn <91nT\ 

2 . .. 

+ g^(*°(a;,y) + 2 ^ 2 (a;,y)); 


(6.87) 


( 6 . 88 ) 


(6.89) 


/ cdnn 


din T, 


sp{x,y) = -v T (x) y-^h 2 {x,y) + -^-(3 h 2 (x,y) + h 0 (x,y )) 

2 chi 

Solving equations (6.87), we obtain functions a 3 (x,k) and b 3 (x,k) in (6.86): 

bo(x, fc)m44(x) — A)0r, k)(m 34 (x) + |zfcvp(x)) 


a 0 {x,k) = 


Z(x, ^ikvr(x)) 


t, ,s Po{x,k)m 33 (x) - ao(x,k)(m 34 {x) + likv T (x)) 
bo(x ' k) = - Z(x,i,fa r M) -• (690) 


Here 


Z(x, ]-ikv T (x)) = Z(x, 0) + - YfZl + ^-ikv T {x)m^{x) 
o y o 


. lld«\ 

= |nA3+ w) 


?iA4 H - 


27 du\ 


Adx 
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v?p(x) fd\nn ( lldlnT\ 2 
2 dx ) 


+ 


9 

k 2 v^(x) 

9 


dx 


+ -ikv^(x) 


(d\nn lldlnTA 


\ dx 


+ 


2 dx 


(6.91) 


Step 4. Calculation of the inverse Fourier transform of the function 
<p 0 (x,k,v). 

The inverse Fourier transform of the function po(x,k,v) (6.86) yields: 


<Po(x, v) = a 0 (x)p 3 (x , v) + b 0 (x)p 4 (x, v ) . 


(6.92) 


Here 


1 / ,+ °° 

ao(x) = — / exp(i/cx)do(x, fc) dfc , 

27r i-x 
1 / ,+ °° 

bo(x) = — / exp(i/cx)6o(x, fc) dfc . (6.93) 

27r J oe 

Taking into account expressions (6.79), (6.90)-(6.91), and (6.85), we obtain 
finally the explicit expression for the finite-dimensional approximation of the 
zeroth-order term of parametrix expansion (6.92): 


y ro~o o r-\-oo y 

a o{ x ) = — \ Ay I dkexp(ik(x - y))Z~ 1 {x, -ikv T (x)) 

J — OG J — OG 6 

X {^(^,0)/i 3 (^,2/) + y)'m>44,( x ) - Sf}(x,y)m 34 (x )] 

-lifevr(x)[m 34 (a;)/i3(a;,2/) + m 44 (a;)/i4(x, y) + s /3 (x,2/)]| ; 

y r~\~ oo /*+oo ^ 

b o{x) = 7 T / dy dkexp(ik(x - y))Z~ 1 {x, -ikv T (x)) 

J — oo J — oo 6 

x {-Z(a;, 0)/i 4 (x, 2/) + [s/j(x, y)m 33 (x) - s a (x, y)m 34 (x)\ 
ikv T (x)[m 34 (x)h 4 (x,y) + m 33 (x)h 3 (x, y) + s Q (^,2/)]| • (6.94) 


6.3.6 Hydrodynamic Equations 

Now we discuss the utility of obtained results for hydrodynamics. 

The correction to the LM manifold /o(n, u, T)(5.49) has the form: 

fi(n, u, T) = fo(n, u, T)( 1 + <p 0 (n, u, T)) (6.95) 

Here the function <po (n, u, T) is given explicitly by expressions (6.92)-(6.94). 

The usual form of closed hydrodynamic equations for n, n, and T, where 
the traceless stress tensor o ik and the heat flux vector qi are expressed via 
hydrodynamic variables, will be obtained if we substitute the function (6.95) 
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into balance equations of the density, of the momentum, and of the energy. For 
the LM approximation, these balance equations result in the Euler equation 
of the nonviscid liquid (i.e. <Jik(fo) = 0, and qi(fo) = 0). For the correction /i 
(6.95), we obtain the following expressions of a = <J xx {fi ) and q = q x (fi) (all 
other components are equal to zero in the one-dimensional situation under 
consideration): 


1 

cr = -na 0 , 



(6.96) 


Here ao and bo are given by expression (6.94). 

From the geometrical viewpoint, hydrodynamic equations with the stress 
tensor and the heat flux vector (6.96) have the following interpretation: we 
take the corrected manifold which consists of functions /i (6.95), and we 
project the Boltzmann equation vectors J u {fi ) onto the tangent spaces Tf 1 
using the quasiequilibrium projector Pf 0 (5.55). 


6.3.7 Nonlocality 


Expressions (6.94) include nonlocal spatial dependence, and, hence, the cor¬ 
responding hydrodynamic equations are nonlocal. This nonlocality enters 
in two different ways. The first source of nonlocality might be called a 
frequency-response nonlocality , and it enters through explicit non-polynomial 
/c-dependence of integrands in (6.94). This latter dependence has the form: 



A{x,y) + ikB(x,y) 

C(x, y) + ikD(x, y) + k 2 E(x , y) 


ex.p(ik(x — y)) dk . 


(6.97) 


Integration over k in (6.97) can be completed via auxiliary functions. 

The second type of nonlocal contributions might be called correlative 
nonlocality , and it is due to the terms (u(x) — u(y)) (the difference of flow 
velocities in points x and y) and via T(x)/T(y) (the ratio of temperatures in 
distant points x and y). 


6.3.8 Acoustic Spectra 

The frequency-response nonlocality in hydrodynamic equations is relevant to 
small perturbations of the uniform equilibrium. The stress tensor a and the 
heat flux g(6. 96) are: 


a = ~(2/3)n 0 T 0 R ; 

<7 = -(5/4)T 0 3/2 n 0 i? _ ( 8 / 5 ) £2 |^'j • ( 6 - 98 ) 


Here 
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R= (l-(2/5)e 2 -^j -1. (6.99) 

In (6.98), we have expressed parameters A 3 and A 4 via the viscosity coeffi¬ 
cient /i of the Chapman-Enskog method [70] (it is easy to see from (6.78) 
that A 3 = A 4 oc for spherically symmetric models of a collision), and 
we have used the following notations: Tq and no are the equilibrium tem¬ 
perature and density, £ = (? 7 T 0 1 ^ 2 ) _1 nox is the dimensionless coordinate, 
r] = /x(T 0 )/T 0 ,?/ = T 0 -1 / 2 $n, T' = JT/T 0 ,n' = Sn/n 0 , and 5u,5T,5n are the 
deviations of the flux velocity, of the temperature and of the density from 
their equilibrium values u = 0, T = To and n = no- We also used the system 
of units with ks = m = 1. 

In the linear case, the parametrix expansion degenerates, and its zeroth- 
order term (6.61) gives the exact solution to equation (6.38). 

The dispersion relationship for the approximation (6.98) is: 

cj 3 + (23 k 2 /dD)u 2 + {k 2 + (2k 4 /D 2 ) + (8k 6 /5D 2 )} uj + (5k 4 /2D) = 0 ; 

D = 1 + (4/5 )k 2 . (6.100) 

Here k is the wave vector. 

The acoustic spectrum given by the dispersion relationship (6.100) con¬ 
tains no nonphysical short-wave instability, unlike the Burnett approximation 
(Fig. 6.2). The regularization of the Burnett approximation [43,44] gives a 
similar result. Both of these approximations predict a limit of the decrement 
Rea; for short waves. These issues will be addressed in more detail in Chap. 8. 


6.3.9 Nonlinearity 

Nonlinear dependence on on , and on d ^ n appears already in the 
local approximation (/q oc (6.79). In order to outline some features of this non¬ 
linearity, we represent the zeroth-order term of the expansion of ai oc (6.79) 
into powers of and 


2 du f 11 du\ 

aioc = ~3dx ( nA3 + y^J 


-1 


o 


{dlnT SlnrA 


( 6 . 101 ) 


This expression describes the asymptotic of the “purely nonlinear” contribu¬ 
tion to the stress tensor <7 (6.96) for a strong divergency of a flow. The account 
of nonlocality yields instead of (6.98): 


a 0 (x) = - — 




r+°° 2 du 

dkex.p(ik(x — y))-— ( n\s + 


x 11 du 

nxs+ -jai 


x 27 du 

nA4 + T dx 


+ 


3 dy 
k 2 Vj l 


-1 


11 du\ 
9 dy) 


x 
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Fig. 6.2. Acoustic dispersion curves for approximation (6.98) (solid line), for second 
(the Burnett) approximation of the Chapman-Enskog expansion [72] (dashed line) 
and for the regularization of the Burnett approximation via partial summing of the 
Chapman-Enskog expansion [43,44] (punctuated dashed line). Arrows indicate the 
direction of increase of k 2 


X 


^nA 3 + 


11 du\ 

9 dx J 


^n\4 + 


27 du\ 
4 dx J 




27 du\ 
4 dy ) 



(u(x) 


+0 


/Sin T 31nn\ 
\ dx ’ dx ) 


u(y )) 2 


2 

3 


ik^(u(x) 

ox 


u (y )) 


( 6 . 102 ) 


Both expressions, (6.101) and (6.102) become singular when 

du / du \ * 9nA 3 

dy \dy) 11 


(6.103) 


Hence, the stress tensor (6.97) becomes infinite if tends to in any point 
y. In other words, the flow becomes “infinitely viscous” when approaches 
the negative value — . This infinite viscosity threshold prevents a transfer 

of the flow into nonphysical region of negative viscosity if because 

of the “infinitely strong damping” at This peculiarity was detected in 
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[43,44] as a result of partial summation of the Chapman-Enskog expansion. 
In particular, partial summing for the simplest nonlinear situation [45, 233] 
yields the following expression for the stress tensor cr: 




(6.104) 


Notations here follow (6.98) and (6.99). Expression (6.104) might be con¬ 
sidered as a scetch of the “full” stress tensor defined by ao(6.94). It takes 
into account both the frequency-response and the nonlinear contributions 
{(J\ R and an R , respectively) in a simple form of a sum. However, the su¬ 
perposition of these contributions in (6.94) is more complicated. Moreover, 
the explicit correlative nonlocality of expression (6.94) was detected neither 
in [45], nor in numerous examples of partial summation [233]. 

Nevertheless, approximation (6.104) contains the peculiarity of viscosity 
similar to that in (6.101) and (6.102). In dimensionless variables and e = 1, 
expression (6.104) predicts the infinite threshold at velocity divergency equal 
to —(3/7), rather than —(9/11) in (6.101) and (6.102). Viscosity tends to zero 
as the divergency tends to positive infinity in both approximations. A physical 
interpretation of these phenomena was given in [45]: large positive values of 
means that the gas diverges rapidly, and the flow becomes nonviscid because 
the particles retard to exchange their momentum. On contrary, its negative 
values (such as —(3/7) for (6.104) and —(9/11)) for (6.101) and (6.102)) 
describe a strong compression of the flow. Strong deceleration results in a 
“solid fluid” limit with an infinite viscosity (Fig. 6.3). 

Thus, hydrodynamic equations for approximation (6.95) are both nonlin¬ 
ear and nonlocal. This result is not surprising, accounting for the integro- 
differential nature of equation (6.38). 

It is important that no small parameters were used neither when we were 
deriving equation (6.38) nor when we were obtaining the correction (6.95). 

6.4 Example: Non-Perturbative Derivation 

of Linear Hydrodynamics 

from the Boltzmann Equation (3D) 

In this example we shall discuss a bit more about the linear hydrodynamics 
obtained by the Newtom method with incomplete linearization. Using the 
Newton method instead of power series, a model of linear hydrodynamics is 
derived from the Boltzmann equation for regimes where the Knudsen number 
is of order unity. The model demonstrates no violation of stability of acoustic 
spectra in contrast to the Burnett hydrodynamics. 
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Fig. 6.3. Dependency of viscosity on compression for approximation (6.101) (solid 
line), for partial summing (6.104) (punctuated dashed line), and for the Burnett 
approximation [45,233] (dashed line). The latter changes the sign at a regular point 
and, hence, nothing prevents the flow to transfer into the nonphysical region 


The Knudsen number e (a ratio between the mean free path, Z c , and 
a scale of hydrodynamic flows, lh) is a smalness parameter when hydrody¬ 
namics is derived from the Boltzmann equation [239]. The Chapman-Enskog 
method [70] derives the Navier-Stokes hydrodynamic equations as the first- 
order correction to the Euler hydrodynamics at 5 —> 0, and it also derives for¬ 
mal corrections of order £ 2 , £ 3 , ... (known as the Burnett and super-Burnett 
corrections). These corrections are important outside the strictly hydrody¬ 
namic domain £ < 1, and has to be considered for an exension of hydro- 
dynamic description into a highly nonequilidrium domain e < 1. Not much 
is known about high-order in 5 hydrodynamics, especially in nonlinear case. 
Nonetheless, in linear case, some definite information can be obtained. On 
the one hand, experiments on sound propagation in noble gases are consid¬ 
erably better explained with the Burnett and super-Burnett hydrodynamics 
rather than with the Navier-Stokes approximation alone [241]. On the other 
hand, direct calculation shows non-physical behavior of the Burnett hydro¬ 
dynamics for ultra-short waves: acoustic waves increase instead of decay [72]. 
The latter failure of the Burnett approximation cannot be ignored. For the 
Navier-Stokes approximation no such violation is observed. 

These two results indicate that, at least in a linear regime, it makes sense 
to consider hydrodynamics at £ ~ 1, but the Chapman-Enskog method of 
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deriving such hydrodynamics is problematic. The problem of constructing 
solutions to the Boltzmann equation valid when s is of order one is one of 
the main open problems of classical kinetic theory [239]. 

The main idea of the present example is to formulate the problem of 
a finding a correction to the Euler hydrodynamics in such a fashion that 
expansions in e do not appear as a necessary element of analysis. This will be 
possible by using the Newton method instead of Taylor expansions to get such 
correction. Resulting hydrodynamic equations do not exhibit the mentioned 
violation. 

The starting point is the set of local Maxwell distribution functions (LM) 
fo(n,u,T;v), where v is the particle’s velocity, and n, u, and T are local 
number density, average velocity, and temperature. We write the Boltzmann 
equation as before in the co-moving reference frame (6.23): 

J(f) = -{v-u) i -d i f + Q(f,f), (6.105) 

where d/d t = d/dt + Ui- di is the material derivative, d{ = d/dxi , while Q is 
the Boltzmann collision integral. 

On the one hand, calculating right hand site of (6.105) in the LM-states, 
we obtain J(/o), a time derivative of the LM-states due to the Boltzmann 
equation. On the other hand, calculating a time derivative of the LM-states 
due to the Euler dynamics, we obtain PoJ(/o), where Po is the thermody¬ 
namic projector operator onto the LM manifold (see [11] and (5.55)): 

Po J =^-{I Jdc + 2a- J CiJdc+l^c 2 -^ J (c*-f)jdc} , 

(6.106) 

Since the LM functions are not solutions to the Boltzmann equation (6.105) 
(except for constant n, n, and T), a difference Z\(/o) between J(/o) and 
PoJ(fo) is not equal to zero (5.59): 

A(fo) = J(fo) - PoJ(fo) (6.107) 

= -fo ( 2 (diUk) (cjCfc - 1<5 ikC 2 ^ + VT^-Ci ^c 2 - 0 | . 

here c = — u), and vt = y/2ksT/m is the thermal velocity. Note 

that the latter expression gives the complete invariance defect of the lin¬ 
earized local Maxwell approximation, and it is neither big nor small by itself. 
An unknown hydrodynamic solution of (6.105), /^(n, n, T; v), satisfies the 
following invariance equation: 

A(foo) = J(foc) - PooJ(foo) = 0 , (6.108) 

where P^ is an unknown projecting operator. Both P^ and are unknown 
in (6.108), but, nontheless, one is able to consider a sequence of corrections 
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{/i, / 2 ,..{Pi, P 2 , • • •} to the initial approximation / 0 and Po. Above it 
was shown, how to ensure the iPtheorem on every step of approximations 
by choosing appropriate projecting operators P n . In the present illustrative 
example we do not consider projectors other than Pq. 

Let us apply the Newton method with incomplete linearization to (6.108) 
with /o as initial approximation for and with P 0 as an initial approxima¬ 
tion for Poo. Writing /i = /o + Sf , we get the first iteration: 

L(6f/f 0 ) + (P 0 - l)(v - u)idiSf + A(f 0 ) = 0 , (6.109) 

where L is a linearized collision integral. 

L(g) 

= fo(v) Jw(v' 1 ,v';v 1 ,v)fo(v 1 ){g(v' 1 )+g(v')-g(v 1 )-g(v)}dv' 1 dv , dvi . 

( 6 . 110 ) 

Here re is a probability density of velocities change, (v,V\) ^ of 

a pair of molecules after their encounter. When deriving (6.109), we have 
accounted P^L = 0, and an additional condition which fixes the same values 
of n, u, and T in states /i as in LM states /q: 


Po£/ = 0. (6.111) 

Equation (6.109) is basic in what follows. Note that it contains no Knud- 
sen number explicitly. Our strategy will be to treat equation (6.109) in such a 
way that the Knudsen number will appear explicitly only at the latest stage 
of computations. 

The two further approximations will be adopted. The first concerns a 
linearization of (6.109) about the global equilibria Po- The second concerns 
a finite-dimensional approximation of integral operator in (6.109) in velocity 
space. It is worthwhile noting here that none of these approximations concerns 
an assumption about the smallness of the Knudsen number. 

Following the first of the approximations mentioned, denote as Sn , 5u, and 
ST deviations of hydrodynamic variables from their equilibrium values no, 
Uq = 0, and To- Introduce also dimensionless variables An = Jn/no, Au = 
Su/v^i and AT = JT/To, where is a heat velocity in equilibria, and a 
dimensionless relative velocity £ = v/v^. Correction /i in the approximation, 
linear in deviations from Po, reads: 

fi = Po(l + To + Vi) ^ 


where 

tfio = An + 2 AU& + AT(t 2 - 3/2) 

is a linearized deviation of LM from Pq, and ipi is an unknown function. The 
latter is to be obtained from a linearized version of (6.109). 
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Following the second approximation, we seek (p\ in a form: 

¥>i = M*)& (V - 0 + B ik (x) - \ s ik^j + • • • 


( 6 . 112 ) 


where dots denote terms of an expansion of in velocity polynomials, or¬ 
thogonal to — 5/2) and — 1/3(^£ 2 , as well as to 1 , to £, and to 
£ 2 . These terms do not contribute to shear stress tensor and heat flux vec¬ 
tor in hydrodynamic equations. Independency of functions A and B from £ 2 
amounts to the first Sonine polynomial approximation of viscosity and heat 
transfer coefficients. Thus, we consider a projection onto a finite-dimensional 
subspace spanned by — 5/2) and — 1/3 5ik£ 2 . Our goal is to derive 
functions A and B from a linearized version of (6.109). Knowing A and F, 
we get the following expressions for shear stress tensor a and heat flux vector 
Q- 

a = p 0 B, q = ^pov^A , (6.113) 

where po is equilibrium pressure of ideal gas. 

Linearizing (6.109) near Fq, using an ansatz for cpi cited above, and turn¬ 
ing to Fourier transform in space, we derive: 

-^-a$(fe) + iv^bij(k)kj = — ~iv^kiT(k) ; (6.114) 

3?7o 2 

— bij(k ) + iv^kiaj(k) = —2iv^kijj(k) , 

Vo 


where i = yf—i, k is the wave vector, 770 is the first Sonine polynomial 
approximation of shear viscosity coefficient, a(fe), b(fe), r(k) and 7 (fe) are 
Fourier transforms of A(x), B(x), AT(x ), and Au(x ), respectively, and the 
over-bar denotes a symmetric traceless dyad: 


&ibj — 2 &ibj 5ijCL s b s . 

o 


Introducing a dimensionless wave vector / = [(v^rjo)/(po)]k, solution to 
(6.114) may be written: 


M*) = “yi7l(fc)/j[( V3) + (1/2 )/ 2 ]- 1 (6.115) 

+ ^(7,(fe)/ s )/z/,[(5/3) + (l/2)/ 2 ]- 1 [5 + 2f 2 ]~ 1 -^r(k)f l f j [5 + 2 / 2 ]" 1 ; 

= -y*/i T ( fc )[5 + 2/ 2 ] -1 

-[5 + 2/ 2 ]- 1 [(5/3) + (1/2 )/ 2 ] -1 [(5/3)7) ( 7 S (fc)/ s ) + + 2 f 2 )} . 


Considering z-axis as a direction of propagation and denoting k z as fc, 7 
as 7 s, we obtain from (6.114) the /^-dependence of a = and b = b zz : 
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|pp 1 T] 0 v^ikT(k) + fp 0 2 r?g( 4 ) 2 fc 2 7 (fc) 

a( j i + |Po 2 % 2 K) 2 fc 2 

= jlV 1 ??o^zfc 7 (fc) +Po 2 ??g( 4 ) 2 fc 2 r(fc) 

^ l + lPo 2 % 2 K ) 2 ^ 2 


(6.116) 


Using expressions for cr and q cited above, and also using (6.116), it is 
an easy matter to close the linearized balance equations (given in Fourier 
terms): 


0 , (6.117) 

0 , 

0 . 

The equations (6.117), together with expressions (6.116), complete our 
derivation of hydrodynamic equations. 

To this end, the Knudsen number was not penetrating our derivations. 
Now it is worthwhile to introduce it. The Knudsen number will appear most 
naturally if we turn to dimensionless form of (6.116). Taking l c = v^Vo/Po 
(l c is of order of a mean free path), and introducing a hydrodynamic scale 
lh, so that k = hv/lh: where ft is a not-dimensional wave vector, we obtain in 
(6.116): 


-Q-d t v(k) + ikjk = 


-- w d t 'y(k ) + ik(r(k) + i/(fe)) + ikb(k) = 

3 5 

— q-Ot + ik^{k) + -ika(k) = 


a(ft) = 


6(k) = 


3 

2 


4 

3 


i£kt(k ) + |e 2 /t 2 7 K 

1+ §£ 2 K 2 

ieK'y(K) + £ 2 k 2 t(k) 

1 + |e 2 /t 2 


(6.118) 


where e = l c /lh • Considering the limit e —> 0 in (6.118), we come back to 
the familiar Navier-Stokes expressions: cr^ z s = —^r]od z 5u z , q^ s = — Ao d z ST, 
where Ao = 15^5^0/4^ is the first Sonine polynomial approximation of heat 
conductivity coefficient. 

Since we were not assuming smallness of the Knudsen number e while 
deriving (6.118), we can write £ = 1. With all the approximations mentioned 
above, (6.117) and (6.116) (or, equivalently, (6.117) and (6.118)) may be 
considered as a model of a linear hydrodynamics at 5 of order one. The most 
interesting feature of this model is a non-polynomial dependence on ft. This 
amounts to that share stress tensor and heat flux vector depend on spatial 
derivatives of Su and of ST to arbitrary high order. 

To find out a result of the non-polynomial behavior (6.118), it is most 
informative to calculate a dispersion relation for plane waves. Let us introduce 
a dimensionless frequency A = l ulh/vji, where uj is a complex frequency of a 
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Fig. 6.4. Attenuation rate of sound waves. Dotts : the Burnett approximation. 
Bobylev’s instability occurs when the curve intersects the horizontal axis. Solid : 
First iteration of the Newton method on the invariance equation 


wave ^exp (ut+ikz) (Rea; is a damping rate, and Ima; is a circular frequency). 
Making use of (6.117) and (6.118), writing e = 1, we obtain the following 
dispersion relation A (ft): 

12(1 + §k 2 ) 2 A 3 + 23k 2 (1+|k 2 )A 2 +2k 2 (5+5k 2 + N 4 )A + 1N 4 (1 + §k 2 ) = 0 . 
5 5 5 2 5 

(6.119) 

Figure 6.4 presents a dependence Re A (ft 2 ) for acoustic waves obtained 
from (6.119) and for the Burnett approximation [72]. The violation in the 
latter occurs when the curve crosses the horizontal axis. In contrast to the 
Burnett approximation [72], the acoustic spectrum (6.119) is stable for all ft. 
Moreover, Re A (ft 2 ) demonstrates a finite limit, as ft 2 —» oo. 

A discussion of results concerns the following two items: 

1. The approach used avoids expansion into powers of the Knudsen number, 
and thus we obtain a hydrodynamics valid (at least formally) for moderate 
Knudsen numbers as an immediate correction to the Euler hydrodynamics. 
This is in a contrast to the usual treatment of high-order hydrodynamics as 
“(the well established) Navier-Stokes approximation + high-order terms”. 
The Navier-Stokes hydrodynamics is recovered a posteriori, as a limiting 
case, but not as a necessary intermediate step of computations. 

2 . Linear hydrodynamics derived is stable for all fc, same as the Navier-Stokes 
hydrodynamics alone. The (1 + ak 2 )~ 1 “cut-off”, as in (6.116) and (6.118), 
was earlier found in a “partial summing” of Enskog series [42,43]. 
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Thus, we come to the following two conclusions: 

1. A positive answer is given to the question of whether is it possible to con¬ 
struct solutions of the Boltzmann equation valid for the Knudsen number 
of order one. 

2. Linear hydrodynamics derived can be used as a model for e = 1 without 
a violation of acoustic spectra at large k. 

6.5 Example: Dynamic Correction 
to Moment Approximations 

6.5.1 Dynamic Correction or Extension of the List of Variables? 

Considering the Grad moment ansatz as a suitable first approximation to a 
closed finite-moment dynamics, the correction is derived from the Boltzmann 
equation. The correction consists of two parts, local and nonlocal. Locally cor¬ 
rected thirteen-moment equations are demonstrated to contain exact trans¬ 
port coefficients. Equations resulting from the nonlocal correction give a 
microscopic justification to some phenomenological theories of extended hy¬ 
drodynamics. 

A considerable part of the modern development of nonequilibrium ther¬ 
modynamics is based on the idea of extension of the list of relevant variables. 
Various phenomenological and semi-phenomenological theories in this domain 
are known under the common title of the extended irreversible thermodynam¬ 
ics (EIT) [235]. With this, the question of a microscopic justification of the 
EIT becomes important. Recall that a justification for some of the versions 
of the EIT was found witin the well known Grad moment method [201]. 

Originally, the Grad moment approximation was introduced for the pur¬ 
pose of solving the Boltzmann-like equations of the classical kinetic theory. 
The Grad method is used in various kinetic problems, e.g., in plasma and in 
phonon transport. We mention also that Grad equations assist in understand¬ 
ing asymptotic features of gradient expansions, both in linear and nonlinear 
domains [40,42,205,219,233]. 

The essence of the Grad method is to introduce an approximation to the 
one-particle distribution function / which would depend only on a finite num¬ 
ber N of moments, and, subsequently, to use this approximation to derive a 
closed system of N moment equations from the kinetic equation. The number 
N (the level at which the moment transport hierarchy is truncated) is not 
specified in the Grad method. One particular way to choose N is to obtain an 
estimation of the transport coefficients (viscosity and heat conductivity) suf¬ 
ficiently close to their exact values provided by the Chapman-Enskog method 
(CE) [70]. In particular, for the thirteen-moment Grad approximation it is 
well known that transport coefficients are equal to the first Sonine polynomial 
approximation to the exact CE values. Accounting for higher moments with 
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N > 13 can improve this approximation (good for neutral gases but poor for 
plasmas [231]). However, what should be done, starting with the thirteen- 
moment approximation, to come to the exact CE transport coefficients is an 
open question. It is also well known [204] that the Grad method provides 
a poorly converging approximation when applied to strongly nonequilibrium 
problems (such as shock and kinetic layers). 

Another question comes from the approximate character of the Grad equa¬ 
tions, and is discussed in frames of the EIT: while the Grad equations are 
strictly hyperbolic at any level N (i.e., predicting a finite speed of propaga¬ 
tion), whether this feature will be preserved in the further corrections. 

These two questions are special cases of a more general one, namely, 
how to derive a closed description with a given number of moments? Such 
a description is sometimes called mesoscopic [251] since it occupies an in¬ 
termediate level between the hydrodynamic (macroscopic) and the kinetic 
(microscopic) levels of description. 

Here we aim at deriving the mesoscopic dynamics of thirteen moments 
[21] in the simplest case when the kinetic description satisfies the linearized 
Boltzmann equation. Our approach will be based on the two assumptions: 

(i) The mesoscopic dynamics of thirteen moments exists, and is invariant 
with respect to the microscopic dynamics, 

(ii) The thirteen-moment Grad approximation is a suitable first approxima¬ 
tion to this mesoscopic dynamics. 

The assumption (i) is realized as the invariance equation for the (unknown) 
mesoscopic distribution function. Following the assumption (ii), we solve the 
invariance equation iteratively, taking the Grad approximation for the input 
approximation, and consider the first iteration (further we refer to this as to 
the dynamic correction, to distinguish from constructing another ansatz). We 
demonstrate that the correction results in the exact CE transport coefficients. 
We also demonstrate how the dynamic correction modifies the hyperbolicity 
of the Grad equations. A similar viewpoint on derivation of hydrodynamics 
was earlier developed in [11] (see previous examples). We shall return to a 
comparison below. 


6.5.2 Invariance Equation 

for Thirteen-Moment Parameterization 

We denote as no, Uq =0, and po the equilibrium values of the hydrodynamic 
parameters (n is the number density, u is the average velocity, and p = nksT 
is the pressure). The global Maxwell distribution function F is 

F = no(nr) _3 7r _3 / 2 exp(—c 2 ) , 

where vt = V^bToui -1 is the equilibrium thermal velocity, and c = v/vt 
is the peculiar velocity of a particle. The near-equilibrium dynamics of the 
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distribution function, / = P( 1 + </?), is due to the linearized Boltzmann 
equation: 

d t p = Jp = -v T Cidiip + Lcp , 

Lcp = J wFfpvi^ipiv^) + (/?(V) — <£>(vi) — <^(t;)] dv' dui , 

where L is the linearized collision operator, and w is the probability density 
of pair encounters. Furthermore, 5| = d/dxi , and summation convention in 
two repeated indices is assumed. 

Let n = Sn/no, u = Su/vt , V — $p/Po (p = n -\-T, T = JT/To), be 
dimensionless deviations of the hydrodynamic variables, while a = Scr/po 
and q = Sq/(poVr ) are dimensionless deviations of the stress tensor cr, and 
of the heat flux q. The linearized thirteen-moment Grad distribution function 
is /o = F(c) [1 + po\, where 

Po = Pi + <P 2 , (6.120) 

ipt*=n + 2 mci + T [c 2 - (3/2)] , 

P2 = VikCiCk + (4/5 )qiCi [c 2 - (5/2)] . 

The overline denotes a symmetric traceless dyad. We use the following con¬ 
vention: 


CLibk = aibk + a k bi - -5 ik aibi , 

O 

difk = difk + dkfi - jj d ik difi . 

The thirteen-moment Grad’s equations are derived in two steps: first, the 
Grad’s distribution function (6.120) is inserted into the linearized Boltzmann 
equation to give a formal expression, d t po = Jp o, second, projector Po is 
applied to this expression, where Po = Pi + P 2 , and operators Pi and P 2 act 
as follows: 


PiJ = 


P 2 J = 


F 

n 0 

F 

n 0 


{ X °J 

f XoJdv + Xi 

j XiJ&v + X A 

K 

[ Y ik Jdv + Zij 

[ ZiJdv^ . 


J XtJdvJ 


( 6 . 121 ) 


Here X 0 = l. X t = \f2ci, where i = 1,2,3, X 4 = ^/2/3 (c 2 — §), Y ik = 
and (c 2 — |). The resulting equation, 


Po[Fd t po\ = Po[FJpo\ , 


is a compressed representation for the thirteen-moment Grad equations for 
the macroscopic variables M 13 = {n, n, T, cr, q}. 
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Now we turn our attention to the main purpose of this example, and 
derive the dynamic invariance correction to the thirteen-moment distribu¬ 
tion function (6.120). The assumption (i) [existence of closed dynamics of 
thirteen moments] implies the invariance equation for the true mesoscopic 
distribution function, /(Mi 3 ,c) = F[ 1 + <£>(Mi 3 ,c)], where we have stressed 
that this function depends parametrically on the same thirteen macroscopic 
parameters, as the original Grad approximation. The invariance condition for 
/(Mi 3 , c) reads [111: 

(1 -P)[FJ(p\ = 0, (6.122) 

where P is the projector associated with /. Generally speaking, the projector 
P depends on the distribution function / [11,231]. In the following, we use the 
projector Pq ( 6 . 121 ) which will be consistent with our approximate treatment 
of ( 6 . 122 ). 

Following the assumption (ii) [Grad’s distribution function (6.120) is a 
good initial approximation], the Grad’s function /o, and the projector Pq, 
are chosen as the input data for solving the equation (6.122) iteratively. The 
dynamic correction amounts to the first iterate. Let us consider these steps 
in a more detail. 

Substituting ipo (6.120) and Pq ( 6 . 121 ) instead of cp and P in the equation 

(6.122) , we get: (1 — Pq)[F Jipo\ e do / 0, which demonstrates that (6.120) 
is not a solution to the equation ( 6 . 122 ). Moreover, Aq splits in two natural 
pieces: Aq = A 1 q c + Aq 1oc , where 

Aft c = (l-P 2 )[FL V > 2 ], (6.123) 

< oc = (1 - P 0 )[-v T Fc i d i 'po] ■ 

Here we have accounted for Pi[FL<p] = 0, and Ltpi = 0. The first piece of 

(6.123) , A l 0 oc , can be termed local because it does not account for spatial 
gradients. Its origin is twofold. In the first place, recall that we are per¬ 
forming our analysis in a non-local-equilibrium state (the thirteen-moment 
Grad’s approximation is not a zero point of the Boltzmann collision integral, 
hence Lip o ^ 0). In the second place, specializing to the linearized case under 
consideration, functions cc and c[c 2 * — (5/2)], in general, are not the eigen¬ 
functions of the linearized collision integral, and hence P 2 [FL(po\ ^ FL^q, 
resulting in Z\q oc ^ 0 2 . 

The nonlocal part may be written as: 

AS loc = -v T F(nn krs d k cr rs + n 2 \ ik d k qi + n 3 d k q k ) , (6.124) 

where 77 are velocity polynomials: 


2 Except for Maxwell molecules (interaction potential U ~ r 4 ) for which Lipo ^ 0 

but P 2 [FLpq\ = FLpo. Same goes for the relaxation time approximation of the 

collision integral (L = —r _1 ). 
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Hl\k rs — Ck [^rds (l/3)^ rs c j (2/5)(5/ cs C r C 5 
n 2 \ik = (4/5) [c 2 - (7/2)] [ac k - (1/3 )5 ik c 2 ] , 
n 3 = (4/5) [c 2 - (5/2)] [c 2 - (3/2)] - c 2 . 

We seek the dynamic correction of the form: 

/ = F[1 + ip 0 + <j>] . 

Substituting (p = + </>, and P = Po, info ( 6 . 122 ), we derive an equation for 

the correction <j)\ 

(1 - P 2 )[FL(<p 2 + </>)] = (1 - Po^vtFcMpo + </>)] . (6.125) 

The equation (6.125) should be supplied with the additional condition, 
P o [F0]=O. 

6.5.3 Solution of the Invariance Equation 

Let us apply the usual ordering to solve (6.125), introducing a small pa¬ 
rameter e, multiplying the collision integral L with e -1 , and expanding 
e n (j)( n \ Subject to the additional condition, the resulting sequence 
of linear integral equations is uniquely soluble. Let us consider the first two 
orders in e. 

Because A}f c ^ 0, the leading correction is of the order e°, i.e. of the same 
order as the initial approximation <po. The function is due the following 
equation: 

{l-P 2 )[FL{y 2 +^)\=0, (6.126) 

subject to the condition, Po[Fqb^] = 0. The equation (6.126) has the unique 
solution: cp 2 + (j)^ = + qiZ\°\ where functions, and are 

solutions to the integral equations: 

LY^ = bY ik , Lz\ Q) = aZi , (6.127) 

subject to the conditions, P\ [ 7 'Y ,0) ] = 0 and P\ [FZ (U) ] = 0. Factors a and b 
are: 

a = i r“ 3/2 J e-^zf ] Lzf ] dc , 

b = n~^J e- c2 4 0) t4 0) dc. 

Now we are able to notice that the equation (6.127) coincides with the CE 
equations [70] for the exact transport coefficients (viscosity and temperature 
conductivity). Emergency of these well known equations in the present con¬ 
text is important and rather unexpected: when the moment transport equa¬ 
tions are closed with the locally corrected function f loc = F (1 -\-(po + we 
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come to a closed set of thirteen equations containing the exact CE transport 
coefficients. 

Let us analyze the next order (e 1 ), where Z\o loc comes into play. To sim¬ 
plify matters, we neglect the difference between the exact and the approxi¬ 
mate CE transport coefficients. The correction (jft) is due to the equation, 


(1 - P 2 )[FL^] + Zig loc = 0 


(6.128) 


the additional condition is: Pof-F^ 1 )] = 0. The problem (6.128) reduces to 
three integral equations of a familiar form: 


(6.129) 


L&i\krs — IIi\krs 5 LE 2 \ik — n 2 \ ik , LF 3 — 77 3 , 


subject to conditions: Pi[FFi\ krs ] = 0, Pi[FF 2 \ ik ] = 0, and Pi[F\Pf\ = 0. 
Integral equations (6.129) are of the same structure as are the integral equa¬ 
tions appearing in the CE method, and the methods to handle them are well 
developed [70]. In particular, a reasonable and simple approximation is to 
take = —A a II a \ . Then 


— —VT(AiIIi\ krs d k <7 rs + A 2 II 2 \ ik d k qi + A 3 IJ 3 d k q k ) , (6.130) 


where A a are the approximate values of the kinetic coefficients, and which 
are expressed via matrix elements of the linearized collision integral: 



(6.131) 


The evaluation can be extended to a computational scheme for any given 
molecular model (e.g., for the Lennard-Jones potential), in the manner of 
the transport coefficients computations in the classical Chapman-Enskog 
method. 

6.5.4 Corrected Thirteen-Moment Equations 

To summarize the results of the dynamic correction, we quote first the un¬ 
closed equations for the variables M 13 = M 13 = {n, u, T, cr, qj: 


(1 /vj)dtn + diUi = 0 , (6.132) 

(2 /v%)d t Ui + di(T + n) + d k cr ik = 0 , (6.133) 

(1 /v°)d t T + (2/3 )d iUi + (2/3)d iqi = 0 , (6.134) 


(1 /v^)dta ik + 2diU k - (2/3 )diq k + dih ik i = Rik , (6.135) 

(2/v T )d tqi - ( 5 / 2 )d iP - ( 5 / 2 )d k a ik + d k g ik = R t . (6.136) 


Terms spoiling the closure are: the higher moments of the distribution func¬ 
tion, 
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hiki = 27 r _3/2 J e~° 2 (fiCiC k cidc , 

g ik = 2 tt _3/2 J e _c VcjCfcC 2 dc , 

and the scattering rates, 

Rik = —7 r -3 / 2 [ e~ c CiCkLcpdc , 

Ri = — 7 r -3 / 2 [ e~ c CiC 2 L(pdc . 

Vt J 

Grad’s distribution function (6.120) provides the zeroth-order closure ap¬ 
proximation to both the higher-order moments and the scattering rates: 

R$ = — J 1 **, R ! 0) = -A, (6.137) 

d i h m = (2/3)5 ik diqi + (4/5 )diq k , 
d l9 ^ = (5/2 )d k (p + T) + (7/2 )d l a lk , 

where /io and Ao are the first Sonine polynomial approximations to the vis¬ 
cosity and the temperature conductivity coefficients [70], respectively. 

The local correction improves the closure of the scattering rates: 

Rik = — i Ri = ~^CE^i ’ (6.138) 

where the subscript CE corresponds to the exact Chapman-Enskog values of 
the transport coefficients. 

The nonlocal correction adds the following terms to the higher-order mo¬ 
ments: 


digik = dig$ - A 3 d k dm - A 2 d l d l q k , (6.139) 

dih ik i = dih — Aididi(Ji k , 

where A\ are the kinetic coefficients derived above. 

In order to illustrate what changes in Grad equations with the nonlocal 
correction, let us consider a model with two scalar variables, T(x,t) and 
q(x,t) (a simplified case of the one-dimensional corrected thirteen-moment 
system where one retains only the variables responsible for heat conduction): 

dfT + d x q = 0, dtq + d x T — ad 2 q + q = 0 . (6.140) 

Parameter a > 0 controls “turning on” the nonlocal correction. Using 
{q(k, uj),T(k, cj)} exp(c at + ikx), we come to a dispersion relation for the two 
roots 071,2 (&). Without the correction (a = 0), there are two domains of k: 
for 0 < k < fc_, dispersion is diffusion-like (Reo/i ? 2 (k) < 0, lmuji^{k) = 0), 
while as k > fc_, dispersion is wave-like (wi(k) = o/|(&), Imo;i(fc) ^ 0). For 



6.5 Example: Dynamic Correction to Moment Approximations 


177 



Fig. 6.5. Attenuation Retail (&) (lower pair of curves), frequency (upper 

pair of curves). Dashed lines - Grad case (a = 0), drawn lines - dynamic correction 
(a = 0.5) 


a between 0 and 1, the dispersion modifies in the following way: The wave- 
like domain becomes bounded, and exists for k E]fc_(a), fc+(a)[, while the 
diffusion-like domain consists of two pieces, k < k-{a ) and k > k+(a). 

The dispersion relation for a = 1/2 is shown in Fig. 6.5. As a increases to 
1 , the boundaries of the wave-like domain, fc_(a) and fc+(a), move towards 
each other, and collapse at a = 1. For a > 1, the dispersion relation becomes 
purely diffusive (ImcJi ^ = 0) for all k. 


6.5.5 Discussion: Transport Coefficients, 

Destroying the Hyperbolicity, etc. 

1 . Considering the thirteen-moment Grad’s ansatz as a suitable approxima¬ 
tion to the closed dynamics of thirteen moments, we have found that the 
first correction leads to the exact Chapman-Enskog transport coefficients. 
Further, the nonlocal part of this correction extends the Grad equations 
with terms containing spatial gradients of the heat flux and of the stress 
tensor, destroying the hyperbolic nature of Grad’s moment system. Cor¬ 
responding kinetic coefficients are explicitly derived for the Boltzmann 
equation. 

2 . Extension of Grad equations with terms like in (6.139) was mentioned 
in the EIT [252]. These derivations were based on phenomenological and 
semi-phenomenological argument. In particular, the extension of the heat 
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flux with appealing to nonlocality effects in dense fluids. Here we have 
derived the similar contribution from the simplest (i.e. dilute gas) kinetics, 
in fact, from the assumption about existence of the mesoscopic dynamics. 
The advantage of using the simplest kinetics is that corresponding kinetic 
coefficients (6.131) become a matter of a computation for any molecular 
model. 

3. When the invariance principle is applied to derive hydrodynamics (closed 
equations for the variables n, u and T) then [11] the local Maxwellian fi m 
is chosen as the input distribution function for the invariance equation. In 
the linear domain, fi m = F[ 1 + <^i], and the projector is P^ m = Pi, see 
(6.120) and (6.121). When the latter expressions are substituted into the 
invariance equation (6.122), we obtain Z\^ m = Af^ c = — vtF {2diUkCjFk + 
d{Fci[c 2 — (5/2)]}, while = 0 because the local Maxwellians are zero 
points of the Boltzmann collision integral. Consequently, the dynamic cor¬ 
rection begins with the order e, and the analog of the equation (6.128) 
reads: 

P ( m = v T {2diU k c + diTa[c 2 - (5/2)]} , 

subject to a condition, Pi[F(f>^] = 0. The latter is the familiar Chapman- 
Enskog equation, resulting in the Navier-Stokes correction to the Euler 
equations [70]. Thus, the nonlocal dynamic correction is related to the 
thirteen-moment Grad equations entirely in the same way as the Navier- 
Stokes are related to the Euler equations. 

4. Let us discuss briefly the further corrections. The first local correction 
(the functions Yi and Zi in (6.127)) is not the limiting point of our 
iterational procedure. When the latter is continued, the subsequent lo¬ 
cal corrections are found from integral equations, PY n+ i = 6 n+ iY n , and 
PZ n+ i = a n+ iZ n . Thus, we are led to the following two eigenvalue prob¬ 
lems: PYoo = frooYoo, and PZ^ = a^ Z^, where and br^ are the 
closest to zero eigenvalues among all the eigenvalue problems with the 
given tensorial structure [248]. 

5. Approach of this example [21] can be extended to derive dynamic correc¬ 
tions to other (non-moment) approximations of interest in the kinetic the¬ 
ory. The above analysis has demonstrated, in particular, the importance 
of the local correction, generically relevant to an approximation which 
is not a zero point of the collision integral. Very recently, this approach 
was successfully applied to improve the nonlinear Grad’s thirteen-moment 
equations [253]. 


7 Quasi-Chemical Representation 


7.1 Decomposition of Motions, Non-Uniqueness 
of Selection of Fast Motions, Self-Adjoint Linearization, 
Onsager Filter, and Quasi-Chemical Representation 

In Chap. 5 we have used the second law of thermodynamics, the existence of 
the entropy, in order to equip the problem of constructing the slow invariant 
manifolds with a geometric structure. The requirement of the entropy growth 
(universally, for all reduced models) restricts significantly the form of the 
projectors (5.25). 

In this chapter we introduce a different but equally important argument - 
the micro-reversibility (T-invariance), and its macroscopic consequences, the 
reciprocity relations. As first discussed by Onsager in 1931 [187], the impli¬ 
cation of the micro-reversibility is the self-adjoint ness of the linear approxi¬ 
mation of the system (3.1) in the equilibrium x *: for any 2 and p, 

((D x J) x *z\p) x * = (, z\(D x J) x ,p) x , . (7.1) 

The main idea in the present chapter is to use the reciprocity relations 
(7.1) for the fast motions. In order to appreciate this idea, we should men¬ 
tion that the decomposition of motions into fast and slow is not unique. Re¬ 
quirement (7.1) for any equilibrium point of fast motions means a selection 
(filtration) of the fast motions. We term this the Onsager filter. Equilibrium 
points of fast motions are all the points on manifolds of slow motions. Ap¬ 
plication of the Onsager filter amounts to a distinguished symmetrization of 
the linearized vector field ( D X J) X in the points x of the slow manifolds. 

To begin with, let us remind the standard way of symmetrization: the 
linear operator A is decomposed into the symmetric and the skew-symmetric 
parts, A = \{A + A*) + |(A — A^). Here A t is adjoint to A with respect 
to a fixed scalar product (entropic scalar product in the present context). 
However, a replacement of an operator with its symmetric part can lead to 
catastrophic (from the physical standpoint) consequences such as, for exam¬ 
ple, loss of stability. In order to construct a sensible Onsager filter, we shall 
use the quasi-chemical representation. 

The formalism of the quasi-chemical representation is one of the most 
developed means of modelling, it makes it possible to “assemble” complex 
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processes out of elementary processes. There exist various presentations of 
the quasi-chemical formalism. Our presentation here is a generalization of the 
approach suggested first by Feinberg [243] (see also [81,242,244]). 

Symbol Ai (“quasi-substance”) is put into correspondence to each vari¬ 
able Xi. The elementary reaction is defined according to the stoichiometric 
equation , 

^OiAi^^PiAi, (7.2) 

i i 

where ai ( the loss stoichiometric coefficients ) and ( the gain stoichiometric 
coefficients ) are real numbers. Apart from the entropy, one has to specify 
a monotonic function of one variable, *F(a), *F'(a) > 0. In particular, the 
function \P(a) = exp(Aa), A = const, is encountered oft in applications. 

Given the elementary reaction (7.2), one defines the rates of the direct 
and of the reverse reactions: 

W+ = w** , 

W~ =w*V ’ (7-3) 

where fa = J^, x* = const, x* > 0. The rate of the elementary reaction is 
then defined as W = IT + — IF . 

The equilibrium of the elementary reaction (7.2) is given by the following 
equation: 

VF + = W~ . (7.4) 

Thanks to the strict monotonicity of the function IF, equilibrium of the ele¬ 
mentary reaction is reached when the arguments of the functions coincide in 
equation (7.3), that is, whenever 

XA& - Oi)lH = 0 • (7.5) 

i 

The vector with the components fa = — ai is termed the stoichiometric 

vector of the elementary reaction. 

Let x° be a point of equilibrium of the reaction (7.2). The linear approx¬ 
imation of the reaction rate has a particularly simple form: 

W(x° +6) = -w*V\a(x°)){i\5) x o + o(S) , (7.6) 

where a(x°) = an d (|) x ° is the entropic scalar 

product in the equilibrium. In other words, 

(D X W) X o = -w*V'(a(x°))( 7 | . (7.7) 

Let us write down the kinetic equation for the elementary reaction: 
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— = 7 TT(x) . (7.8) 

Linearization of this equation at the equilibrium x° has the following form: 

= -w*^'{a(x 0 ))^{^\5) x0 . (7.9) 

That is, the matrix of the linear approximation has the form, 

K = -k* | 7 )<7|, (7.10) 


where 

k* = w*#'(a(x 0 )) > 0 , 

while the entropic scalar product is taken at the equilibrium point x°. 

If there are several elementary reactions, then the stoichiometric vectors 
7 r and the reaction rates W r (x) are specified for each individual reaction, 
while the kinetic equation is obtained by summing the right hand sides of 
equation (7.8) for individual elementary reactions, 

(7.H) 

r 

Let us assume that under the reversion of the motions, the direct reaction 
transforms into the reverse reaction. Thus, the T-invariance of the equilibrium 
means that it is reached in the point of the detailed balance , where all the 
elementary reaction equilibrate simultaneously: 

W+(x*) = W~(x*) . (7.12) 

This assumption is nontrivial if vectors y r are linearly dependent (for exam¬ 
ple, if the number of reactions is greater than the number of species minus 
the number of conservation laws). 

One can call the equations of detailed balance (7.12) the “nonlinear On¬ 
sager relations”. These equations give us the restrictions on the reaction rates 
not only near the equilibrium, in the linear approximation, but also far away 
from the equilibrium. The representation (7.3) is crucial for this continuation 
of the usual linear Onsager relations from the neighbourhood of the equilib¬ 
rium point to the whole phase space. The problem of a rigorous foundation 
of nonlinear Onsager relations [188,189] remains open, but a recent attempt 
made by Berdichevsky [190] seems to be promising. 

In the detailed balance case, the linearization of equation (7.11) in the 
neighborhood of x* has the following form (x = x* + 5): 

f t =-J2KY(Y\5) x *, 


where 


(7.13) 
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k* = w*&r(a*) > 0 , 

a* = ^a[/ii(x*) = . 

i i 

The following matrix of the linear approximation is obviously self-adjoint and 
stable: 

K = ~Y J K\l r ){l r \ ■ (7.14) 

r 

Note that matrix K is the sum of matrices of rank one. 

Let us now extract the self-adjoint part of the form (7.14) in the arbitrary 
point x. Linearizing the reaction rate about x, we obtain: 

W(x + 5) = w* (! V\a(x))(a\5) x - V(b(x)){p\5) x ) + o(5 ) , (7.15) 

where 

a(x ) = ^2aiHi{x) , 
i 

b(x) = ^2/3im(x) . 
i 

Let us introduce notation, 

k SYM (x) = 1 . w* (¥'(a(x)) + &'(b(x))) > 0 , 
k A (x) = t w * (ip'(a(x)) — ty\b(x))) . 

In terms of this notation, equation (7.15) may be rewritten, 

W(x + 8) = -k SYM (x)(^\S) x + k A (x)(a + f3\6) x + o(6) . (7.16) 

The second term vanishes in the equilibrium (fc A (x*) = 0, due to the detailed 
balance). 

The symmetric linearization (Onsager filter) amounts to keeping only the 
first term in the linearized vector field (7.16) when studying the fast mo¬ 
tion towards the (approximate) slow manifolds, instead of the full expression 
(7.15). Matrix K(x) of the linear approximation becomes then similar to 
(7.14): 

K(x) =-J2kf YU (x) |7 r )(7 r |, (7-17) 


kf YM (x) = t w * (^(a(x)) + KiKx))) > 0 , 
a r {x) = > 

b r (x) = y]/3>i(x) , 


where 
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while the entropic scalar product (\) x is taken at the point x. For each label 
of the elementary reaction r, the function kf YM (x) is positive. Thus, the 
stability of the symmetric matrix (7.17) is elicit. 

Symmetric linearization (7.17) is distinguished also by the fact that it 
preserves the rank of the elementary processes contributing to the complex 
mechanism. Same as in the equilibrium case, the matrix K{pc) is the sum of 
rank one operators corresponding to each individual process. This is not so 
for the standard symmetrization. 

Using the symmetric operator (7.17) in the above Newton method with 
incomplete linearization can be considered as a version of a heuristic strategy 
of “we act in such a way as if the manifolds F(W ) were already slow invariant 
manifolds”. If this were the case, then, in particular, the fast motions towards 
the were described by the self-adjoint linear approximation. 

We have described the quasi-chemical formalism for finite-dimensional 
systems. Infinite-dimensional generalizations are almost straightforrwad in 
many important cases, and are achieved by a mere replacement of summa¬ 
tion by integration. The best known example is the Boltzmann collision in¬ 
tegral: each velocity v corresponds to a quasi-substance A Vy and a collision 
is described by a stoichiometric equation: 

Ay + A w Ay! + A w t . 

In the Example to this chapter we consider the Boltzmann collision integral 
from this standpoint in a more detail. 


7.2 Example: Quasi-Chemical Representation 
and Self-Adjoint Linearization 
of the Boltzmann Collision Operator 

A decomposition of motions near a thermodynamically nonequilibrium states 
results in a linear relaxation towards this state. In this Example, the linear 
operator of this relaxation is explicitly constructed in the case of the Boltz¬ 
mann equation. 

Let us remind that the entropy-related specification of the equilibrium 
state is due to the two points of view. From the first, thermodynamic view¬ 
point, equilibrium is a state in which the entropy is maximal. From the sec¬ 
ond, kinetic viewpoint, a quadratic form of the entropy increases in a course 
of linear regression towards this state. If the underlying microscopic dynam¬ 
ics is time-reversible, the kinetic viewpoint is realized due to the well-known 
symmetry properties of the linearized kinetic operator. 

In a majority of near-equilibrium studies, a principle of a decomposition 
of motions into fast and slow occupies a distinct place. In some special cases, 
decomposition of motions is taken into account explicitly, by introducing a 
small parameter into dynamic equations. More frequently, however, it comes 
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into play implicitly, for example, through an assumption of a fast decay of 
memory in the projection operator formalism [194]. Even in presence of long- 
living dynamic effects (mode coupling), an assumption about decomposition 
of motions is required as a final instance to obtain a closed set of equations 
for slow variables. 

However, for closed systems, there remains a question: whether and to 
what extend the two aforementioned entropy-related points of view are ap¬ 
plicable to non-equilibrium states? Further, if an answer is affirmative, then 
how to make explicitly the corresponding specification? 

This Example is aimed at answering the questions just mentioned, and it 
is a straightforward continuation of results [11,14]. Namely, in [11,14], it was 
demonstrated that the principle of motions decomposition alone constitutes 
a necessary and sufficient condition for the thermodynamic specification of a 
non-equilibrium state. However, in a general situation, one deals with states 
/ other than /q. A question is, whether these two ideas can be applied to 
/ 7^ /o (at least approximately), and if so, then how to make the presentation 
explicit. 

The positive answer to this question was partially given in the framework 
of the method of invariant manifolds [9,11,14]. Objects studied in [9,11,14] 
were manifolds in the space of distribution functions, and the goal was to 
construct iteratively a manifold that is tangent in all its points to a vector 
field of a dissipative system (an invariant manifold), beginning with some 
initial manifold with no such property. It was natural to employ methods of 
KAM-theory (Newton-type linear iterations to improve the initial manifold). 
However, additional idea of the decomposition of motions into fast and slow 
near the manifold was required to adapt KAM-theory to dissipative systems. 
The geometrical formulation of this idea [9,11,14] results in a definition of 
a plane of fast motion, Pj, associated with the state /, and orthogonal to 
the gradient of the entropy in /. The physical interpretation of P/ is that 
contains all those states from a neighborhood of /, which come into / in the 
course of fast relaxation (as if / were the final state of fast processes occuring 
in its neighborhood). Usually, P/ contains more states than can come into 
/ in a fast relaxation because of the conservation of certain macroscopic 
quantities (e.g. density, momentum, and energy, as well as, possibly, higher 
moments of / which practically do not vary during the fast processes). The 
redundant states are eliminated by imposing additional restrictions which cut 
out “thinner” linear manifolds, planes of fast motions P/, inside P/. Extremal 
property of / on Tf is preserved also on Pf (cf. [9,11,14]). 

Thus, the decomposition of motions near a manifold results in the thermo¬ 
dynamical viewpoint: the states / on the manifold are described as the unique 
points of the entropy maximum of corresponding planes of fast motions Pj. 
This formulation defines a slow dynamics on the manifolds in agreement with 
the P-theorem for the Boltzmann equation, or with its analogs for other sys¬ 
tems (see [9,11,14] for details). As it was demonstrated in [9,11,14], the 


7.2 Self-Adjoint Linearization of the Boltzmann Collision Operator 185 

decomposition of motions in a neighborhood of / is a criterion (a necessary 
and sufficient condition) of the existence of the thermodynamic description 
of /. 

The Newton iteration improves the states of a non-invariant manifold 
(/ + £/)? while Sf is thought on Tj. Equation for Sf involves a linearization 
of the collision integral in the state /. Here, if / ^ /o, where /o is the 
local equilibrium, we face a problem of how to perform the linearization of 
the collision integral in concordance with the iL-theorem (corrections to the 
manifold of local equilibrium states were studied in detail in [11]). 

Here we show that the aforementioned assumption about the decompo¬ 
sition of motions results in the kinetic description of states on manifolds of 
slow motions, and that Onsager’s principle can be applied in a natural way 
to linearize the Boltzmann collision integral. 

As it follows from the definition to definition of /j, the state / is the 
unique point of minimum of the H- function on //. In the first non-vanishing 
approximation, we have the following expression for the H- function in the 
states on Ij: 

H(f + 6f)nH(f) + ±(6f\5f)f 

Here (-|')/ denotes the scalar product generated by the second derivative of 
H in the state /: ( 51 ( 52 )/ = / / -1 5 i 52 dn. 

Decomposition of motions means that the quadratic form (Sf\Sf) / decays 
monotonically in the course of the linear relaxation towards the state /. It 
is natural, therefore, to impose the requirement that this linear relaxation 
should obey Onsager’s principle. Namely, the corresponding linear operator 
should be symmetric (formally self-adjoint) and non-positively definite with 
respect to the scalar product (-|-)/, and furthermore, the kernel of this oper¬ 
ator should consist of linear combinations of conserved quantities (1, v, and 
v 2 ). In other words, the decomposition of motions should portray the pattern 
of the linear relaxation in the vicinity of / similar to that in a small neigh¬ 
borhood of /o- Following this idea, we shall now decompose the linearized 
collision integral Lf in two parts: L^ YM (satisfying Onsager’s principle), and 
Lj (the non-thermodynamic part). 

In the state /, each direct encounter, (v,v\) —► (t/,^), together with 
the reverse encounter, (t/,!^) —* (v,vi), contribute a rate, G + (/) — L~(f) 
(“gain—loss”), to the collision integral, where (see Chap. 2): 


w(f) = W{v' ,v[\v ,vx) e-xv {D f H\ f=f{v) + D f H\ f=f(Vl) } ■ 

W\f ) = W(v',v l 1 -,v,v 1 )e^{D f H\ f=f{v , ) + D f H\ f=f(v[) } ; 

A deviation Sf from the state / will change the rates of both the direct 
and the reverse processes. Resulting deviations of the rates are: 


sw = W(f ) {DjH\ f=f(v) ■ Sf(v) + D)H\ f=f(Vl) • Sf( Vl )} ; 
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SW' = W'(f) {D}H\ f=fm • 5f(v') + DjH\ f=fiv{) • Sf(v[)} ; 

Symmetrization with respect to the direct and the reverse encounters will 
give a term proportional to a balanced rate, W SYM (f) = | (W(f) + W'(f)), 
in both of the expressions SW and SW f . Thus, we come to the decomposition 


rSYM 

L f 


Sf = 


! 


w 


f'f[ + ffl 


5f_ 

r 


s_n 

fi 


■ sf =J 


w- 


f'f'i - fh 


SYM 1 tA 

7 + L f ’ 

where 


Sfi Sf 

h f 

| dv[ dt/ diq ; 

(7.18) 

Sfi Sf\ 

fl f I 

■ dv[ di/ d^i ; 

(7.19) 


f = f(v), fi = f(v i), f = /( v'), f[ = Sf = 5f(v), Sfi = Sf(v i), 5f = 
6f(v'),6f[ = 5f(v[). 

Operator L® YM (7.18) satisfies all the aforementioned requirements per- 
tinent to Onsager’s principle, namely: 


(i) (5fi|Ly M |5 2 )/ = {g 2 \Lj YM \g 1 ) f (symmetry); 

(ii) (g\L^ YM \g)f < 0 (local entropy production inequality); 

(iii) f,vf,v 2 f E kerZ/j YM (conservation laws). 

For an unspecified /, the non-thermodynamic operator (7.19) has none of 
these properties. If / = /o, then the part (7.19) vanishes, while operator 
becomes the usual linearized collision integral due to the balance W(fo) = 
W'(fo). 

The non-negative definite form (5f\5f)f decays monotonically due to the 
equation of linear relaxation, d t Sf = Lj YM ^/, and the unique point of mini¬ 
mum, Sf = 0, of (Sf\Sf) f corresponds to the equilibrium point of the vector 
field L^ YM Sf. 

Operator L^ YM describes the state / as the equilibrium state of the linear 
relaxation. Note that the method of extracting the symmetric part (7.18) is 
strongly based on the representation of the direct and the reverse processes, 
and it is not a simple procedure like, e.g., \{Lf + Ljr). The latter expres¬ 
sion cannot be used as a basis for Onsager’s principle since it would violate 
conditions (ii) and (iii). 

Thus, if motions do decompose into a fast motion towards the manifold 
and a slow motion along the manifold, then states on this manifold can be 
described from both the thermodynamic and the kinetic points of view. Our 
consideration results in the explicit construction of the operator L^ YM (7.18) 
responsible for the fast relaxation towards the state /. It can be used, in par¬ 
ticular, for obtaining corrections to such approximations as the Grad moment 
approximations and the Tamm-Mott-Smith approximation, in the framework 
of the method of invariant manifold [9,14,21]. The non-thermodynamic part 
(7.19) is always present in Lj, when / 7^ /o, but if trajectories of an equation 
dfSf = LfSf are close to the trajectories of the equation dfSf = L^ YM Sf, 
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then Lj YM is a good approximation to Lf. Statements about closeness of tra¬ 
jectories depend on specific features of /, and typically they can be claimed 
when a small parameter is present. On the other hand, the explicit thermo¬ 
dynamic and kinetic presentation of states on a manifold of slow motions 
(the extraction of L^ YM as above and construction of planes Ff [9,11,14]) is 
based just on the assumption about the decomposition of motions, and can 
be used avoiding a consideration of a small parameter. 



8 Hydrodynamics From Grad’s Equations: 
What Can We Learn From Exact Solutions? 


A detailed treatment of the classical Chapman-Enskog derivation of hydrody¬ 
namics is given in the framework of Grad’s moment equations. Grad’s systems 
are considered as the minimal kinetic models where the Chapman-Enskog 
method can be studied exactly, thereby providing the basis to compare var¬ 
ious approximations in extending the hydrodynamic description beyond the 
Navier-Stokes approximation. Various techniques, such as the method of par¬ 
tial summation, Pade approximants, and invariance principle are compared 
both in linear and nonlinear situations. 


8.1 The “Ultra-Violet Catastrophe” 
of the Chapman-Enskog Expansion 

Most of the interesting expansions in non-equilibrium statistical physics are 
divergent. This paraphrase of the well known folklore “Dorfman’s theorem” 
conveys the intrinsic problem of many-body systems: A number of systematic 
(at the first glance) methods has led to 

- An excellent but already known on the phenomenological grounds first 
approximation; 

- Already the next correction, not known phenomenologically and hence of 
interest, does not exist because of divergence. 

There are many examples of this situations: Cluster expansion of the ex¬ 
act collision integral for dense gases leads to divergent approximations of 
transport coefficients, non-convergent long tails of correlation functions in 
the Green-Kubo formulae etc. 

The derivation of the hydrodynamic equations from a microscopic descrip¬ 
tion is the classical problem of physical kinetics. As is well known, the famous 
Chapman-Enskog method [70] provides an opportunity to compute a solution 
from the Boltzmann kinetic equation as a formal series in powers of the Knud- 
sen number e. The parameter e reflects the ratio between the mean free path 
of a particle, and the scale of variations of the hydrodynamic fields (density, 
mean flux, and temperature). If the Chapman-Enskog expansion is truncated 
at a certain order, we obtain subsequently: the Euler hydrodynamics (e°), 
the Navier-Stokes hydrodynamics (e 1 ), the Burnett hydrodynamics (e 2 ), the 
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super-Burnett hydrodynamics (e 3 ), etc. The post-Navier-Stokes terms ex¬ 
tend the hydrodynamic description beyond the strictly hydrodynamic limit 
e«l. 

However, as it has been first demonstrated by Bobylev [72], even in the 
simplest regime (one-dimensional linear deviations around the global equilib¬ 
rium), the Burnett hydrodynamic equations violate the basic physics behind 
the Boltzmann equation. Namely, sufficiently short acoustic waves are ampli¬ 
fied with time instead of decaying. This contradicts the i7-theorem, since all 
near-equilibrium perturbations must decay. The situation does not improve 
in the next, super-Burnett approximation. 

This “ultra-violet catastrophe” which occurs in the lower-order trunca¬ 
tions of the Chapman-Enskog expansion creates therefore very serious diffi¬ 
culties in the problem of an extension of the hydrodynamic description into a 
highly non-equilibrium domain (see [112] for a discussion of other difficulties 
of the post-Navier-Stokes terms of the Chapman-Enskog expansion). The 
Euler and the Navier-Stokes approximations remain basic in the hydrody¬ 
namic description, while the problem of their extension is one of the central 
open problems of kinetic theory. The study of approximate solutions based 
on the Chapman-Enskog method still continues [74]. 

All this begs for a question: What is wrong with the Chapman-Enskog 
method? At first glance, the failure of the Burnett and of the super-Burnett 
hydrodynamics may be accounted in favor of a frequently used argument 
about the asymptotic character of the Chapman-Enskog expansion. How¬ 
ever, it is worthwhile to notice here that divergences in the low-order terms 
of formal expansions are not too surprising. In many occasions, in particular, 
in quantum field theory [198] and in statistical physics [199], the situation is 
often improved if one takes into account the very remote terms of the corre¬ 
sponding expansions. Thus, a more constructive viewpoint on the Chapman- 
Enskog expansion could be to proceed along these lines, and to try to sum 
up the Chapman-Enskog series, at least formally and approximately. 

An attempt of this kind of working with the Chapman-Enskog expan¬ 
sion is undertaken in this chapter. The formalities are known to be rather 
awkward for the Boltzmann equation, and untill now, exact summations of 
the Chapman-Enskog expansion are known in a very limited number of 
cases [202]. In this chapter, we shall concentrate on the Chapman-Enskog 
method as applied to the well known Grad moment equations [201]. 

The use of the Grad equations for our purpose brings, of course, consid¬ 
erable technical simplifications as compared to the case of the Boltzmann 
equation but it does not make the problem trivial. Indeed, the Chapman- 
Enskog method amounts to a nonlinear recurrence procedure even when ap¬ 
plied to the simplest, linearized Grad equations. Moreover, as we shall see 
soon, the Chapman-Enskog expansion for moment systems inherits Bobylev’s 
instability in the low-order approximations. Still, the advantage of our ap¬ 
proach is that many explicit results can be obtained and analyzed. In order to 
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summarize, in this chapter we consider Grad’s moment equations as finitely- 
coupled kinetic models where the problem of reduced description is meaning¬ 
ful, rather than as models of extended hydrodynamics. The latter viewpoint 
is well known as a microscopic background of the extended irreversible ther¬ 
modynamics [236,252]. 

The outline of this chapter is as follows: after an introduction of the 
Chapman-Enskog procedure for the linearized Grad equations (Subsect. 8.2), 
we shall start the discussion with two examples (the linearized one- and three- 
dimensional 10 moment Grad equations) where the Chapman-Enskog series 
is summed up exactly in closed form (Sects. 8.3.1 and 8.3.2). These results 
makes it possible to discuss the features of the Chapman-Enskog solution 
in the short-wave domain in the framework of the model, and will serve the 
purpose of testing various approximate methods thereafter. We shall see, in 
particular, that the “smallness” of the Knudsen number e used to develop the 
Chapman-Enskog method has no direct meaning in the exact result. Also, it 
will become clear that finite-order truncations, even provided they are stable, 
give less opportunities to approximate the solution in a whole, and especially 
in the short-wave domain. 

The exact solutions are, of course, the lucky exceptions, and even for 
the Grad moment equations the complexity of the Chapman-Enskog method 
increases rapidly with an increase of the number of the moments taken into 
account. Further (Sect. 8.4.1) we shall review a technique of summing the 
Chapman-Enskog expansion partially. This technique is heuristic (as are the 
methods of partial summing in general), but it still removes the Bobylev 
instability, as well as it qualitatively reproduces the features of the exact 
solutions in the short-wave limit. 

The approach of working in the sections mentioned so far falls into the 
paradigm of the Taylor-like expansions into powers of the Knudsen number. 
This viewpoint on the problem of the derivation of the hydrodynamics will be 
altered beginning with Sect. 8.4.2. There we demonstrate that a condition of a 
dynamic invariance which can be realized directly and with no restrictions of 
the Knudsen number brings us to the same result as the exact summation of 
the Chapman-Enskog expansion. The Chapman-Enskog method thereafter 
can be regarded as one possibility to solve the resulting invariance equations. 
Further, we demonstrate that iterative methods provide a reasonable alter¬ 
native to the Taylor expansion in this problem. Namely, we show that the 
Newton method has certain advantages over the Chapman-Enskog method 
(Sect. 8.4.3). We also establish a relationship between the method of partial 
summation and the Newton method. 

The material of further sections serves for an illustrative introduction how 
the pair “invariance equation + Newton method” can be applied to problems 
of kinetic theory. The remaining sections of this chapter are devoted to further 
examples of this approach on the level of the Grad equations. In Sects. 8.4.4 
and 8.4.5 we derive and discuss the invariance equations for the linearized 
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thirteen-moment Grad equations. Section 8.4.6 is devoted to kinetic equations 
of the Grad type, arising in problems of phonon transport in massive solids at 
low temperatures. In particular, we demonstrate that the onset of the second 
sound regime of phonon propagation corresponds to a branching point of the 
exact sum of the relevant Chapman-Enskog expansion. 

In Sect. 8.4.7 we apply the invariance principle to nonlinear Grad equa¬ 
tions. We sum up exactly a subseries of the Chapman-Enskog expansion, 
namely, the dominant contribution in the limit of high average velocities. 
This type of contribution is therefore important for an extension of the hy¬ 
drodynamic description into the domain of strong shock waves. We present 
a relevant analysis of the corresponding invariance equation, and, in particu¬ 
lar, discuss the nature of singular points of this equation. A brief discussion 
concludes this chapter. Some of the results presented below were published 
earlier in [17,40,41,43-45,205,237], and summarized in [42]. 


8.2 The Chapman-Enskog Method 
for Linearized Grad’s Equations 


In this section, for the sake of completeness, we introduce linearized Grad’s 
equations and the Chapman-Enskog method for them in the form that will 
used in the rest of this chapter. Since the Chapman-Enskog method is ex¬ 
tensively discussed in a number of books, especially, in the classical mono¬ 
graph [70], our presentation will be brief. 

The notation will follow that of the papers [43,72]. We denote po> T 0 
and u = 0 the fixed equilibrium values of density, temperature and averaged 
velocity (in the appropriate Galilean reference frame), while Sp , 5T and 5u 
are small deviations of the hydrodynamic quantities from their equilibrium 
values. Grad’s moment equations [201] which will appear below, contain the 
temperature-dependent viscosity coefficient, p(T). It is convenient to write 
/i(T) = rj{T)T. The functional form of rj(T) is dictated by the choice of the 
model for particle interaction. In particular, we have 77 = const for Maxwell’s 
molecules, and 77 ~ y/T for hard spheres. 

We use the system of units in which Boltzmann’s constant &b and the 
particle mass m are equal to one. Let us introduce the following system of 
dimensionless variables: 


u = 


x = 


Su 

Wo’ 

Po 


n _*_P t _6T 

P > T rri 

Po Tq 


V(To)y/J 0 


X 


t = 


Po 

v(To) 


t' , 


( 8 . 1 ) 


where x' are spatial coordinates, and t' is time. Three-dimensional thirteen 
moment Grad’s equations, linearized near the equilibrium, take the following 
form when written in terms of the dimensionless variables ( 8 . 1 ): 
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d t p = -V • u , 

dtu = —Vp — VT — V • <7 , 

d t T = -jj(V-it + V-q) , 


( 8 . 2 ) 



(8.3) 


In these equations, cr(x,t ) and q(x,t) are dimensionless quantities corre¬ 
sponding to the stress tensor and to the heat flux, respectively. Further, the 
gradient V stands for the vector of spatial derivatives d/dx. The dot de¬ 
notes the standard scalar product, while the overline stands for a symmetric 
traceless dyad. In particular, 


_ 2 

Vw = Vw + (Viz) T - -/V • u , 

o 


where / is unit matrix. 

Grad’s equations (8.2) and (8.3) is the simplest model of a coupling 
of the hydrodynamic variables, p(cc,t), T(cc,t) and u(x,t), to the non¬ 
hydrodynamic variables cr(x,t) and q(x,t). The problem of reduced descrip¬ 
tion is to close the first three equations (8.2), and to get an autonomous 
system for the hydrodynamic variables alone. In other words, the non¬ 
hydrodynamic variables cr(x,t) and q(x,t) should be expressed in terms of 
p(cc,t), T(x,t) and u(x,t). The Chapman-Enskog method, as applied for 
this purpose to Grad’s system (8.2) and (8.3), involves the following steps: 

First, we introduce a formal parameter e, and write instead of equations 


(8.3): 


(8.4) 


Of cr = —Vu — - Vqr- a , 

5 e 



Second, the Chapman-Enskog solution is found as a formal expansions of the 
stress tensor and of the heat flux vector: 


oo 


<7 = 5^e n+1 o-("> ; 


(8.5) 


n=0 


oo 



n =0 


The zero-order coefficients, and q(°\ are: 


cr 


(°) = -Vu, q (0) = -^VT. 


( 8 . 6 ) 
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Coefficients of order n > 1 are found from the recurrence procedure: 


ffW = - j ]T d[ m )^{n-l-m) + 2 Vg(n _ 1) | } 

l mn =0 J 

g(«) = + V •Cr( ra - 1 )| , 


(8.7) 


where are recurrently defined Chapman-Enskog operators. They act 

on functions p(x,t), T(x, t) and u(x,t), and on their spatial derivatives, 
according to the following rule: 


d[ m) Dp = 
d[ m) DT = 
d[ m) Du = 


f —DV ■ u m = 0 
\ 0 m > 1 ’ 

f — §DV • u m = 0 

\-§ DV-q( m ~V m > 1 

f—DV(p + T ) m = 0 
\ -DV ■ cr^" 1 ) m > 1 


( 8 . 8 ) 


Here D is an arbitrary differential operator with constant coefficients. 

Given the initial condition (8.6), the Chapman-Enskog equations (8.7) 
and (8.8) are recurrently solvable. Finally, by terminating the computation at 
the order N > 0, we obtain the TVth order approximations to the expansions 
(8.5), cr N and q N : 


N N 

ctn = Y, , q N = Y J e n+ V n) • (8.9) 

n=0 n=0 

Substituting these expressions instead of the functions a and q in (8.2), 
we close the latter to give the hydrodynamic equations of the order N. In 
particular, N = 0 results in the Navier-Stokes approximation, N = 1 and 
N = 2 give the Burnett and the super-Burnett approximations, respectively, 
and so on. 

Though the “microscopic” features of Grad’s moment equations are, 
of course, much simpler in comparison to the Boltzmann equation, the 
Chapman-Enskog procedure just described is not trivial. Our purpose is to 
study explicitly the features of the gradient expansions like (8.5) in the highly 
non-equilibrium domain, and, in particular, to find out to what extend the 
finite-order truncations (8.9) approximate the solution, and what kind of 
alternative strategies to find approximations are possible. In the following, 
when referring to Grad’s equations, we use the notation mDnM , where m 
is the spatial dimension of the corresponding fields, and n is the number of 
these fields. For example, the above system is the 3TH3M Grad’s system. 
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8.3 Exact Summation 

of the Chapman-Enskog Expansion 

8.3.1 The IDIOM Grad Equations 

In this section, we start the discussion with the exact summation of the 
Chapman-Enskog series for the simplest Grad’s system, the one-dimensional 
linearized ten-moment equations. Throughout the section we use the hydro- 
dynamic variables p(x,t) = p(x,t) + T(x,t) and u(x,t), representing the di¬ 
mensionless deviations of the pressure and of the average velocity from their 
equilibrium values (see (8.1)). The starting point is the linearized Grad’s 
equations for p, u , and cr, where a is the dimensionless xx-component of the 
stress tensor: 


d t p=~^d x u, (8.10) 

d t u = -d x p - d x a , 

d t a = ~-d x u - -a . 

3 e 

The system of equations for three functions is derived from the ten- 
moment Grad’s system (see (8.38) below). Equations (8.10) provides the sim¬ 
plest model of a coupling of the hydrodynamic variables, u and p, to the single 
non-hydro dynamic variable cr, and corresponds to a heat non-conductive case. 

Our goal here is to reduce the description, and to get a closed set of 
equations with respect to variables p and u only. That is, we have to express 
the function a in the terms of spatial derivatives of p and u. The Chapman- 
Enskog method, as applied to (8.10) results in the following series represen¬ 
tation: 

oo 

a = e n+ V n) . (8.11) 

n =0 

The coefficients fj <n> are obtained from the following recurrence procedure 
[43]: 

n— 1 

= - Y, 0 t (m) <r( n - 1 - m > , (8.12) 

m =0 

where the Chapman-Enskog operators d[ m ^ act on p, u, and their spatial 
derivatives as follows: 


d[ m) d l x u = 
d[ m) d l x p = 


—c^ +1 p, m = 0 

— m > 1 ’ 

~\®x rlu i m = 0 

0 , m > 1 


(8.13) 


Here l > 0 is an arbitrary integer, and d® = 1. Finally, 
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<T (0) = ~^d x u, (8.14) 

which leads to the Navier-Stokes approximation of the stress tensor: ctns = 

Because of the somewhat involved structure of the recurrence procedure 
(8.12) and (8.13), the Chapman-Enskog method is a nonlinear operation 
even in the simplest model (8.10). Moreover, the Bobylev instability is again 
present. 

Indeed, computing the coefficients and on the basis of (8.12), we 
obtain: 

cr B = ecr (0) + e 2 ^ 1 ) = ~ ( ed x u + e 2 <9 2 p) , (8.15) 

o 

and 

&sb = + e 2 ^ 1 ) + e 3 a ^ = — ^ ^ed x u + e 2 d 2 p + ^e 3 d 3 u S j , (8.16) 

for the Burnett and the super-Burnett approximations, respectively. Now 
we can substitute each of the approximations, ons, 0b , and ctsb for cr in 
the second equation of the set (8.10). The equations thus obtained, together 
with the equation for density p, form the closed systems of the hydrodynamic 
equations of the Navier-Stokes, Burnett, and super-Burnett levels. To see the 
properties of the resulting equations, we compute the dispersion relation for 
the hydrodynamic modes. Using a new space-time scale, x' = e -1 x, and t' = 
e -1 £, and representing u = Ukp(x',t'), and p = pkp(x',t'), where p(x',t') = 
exp(cj£' + ikx '), and k is a real-valued wave vector, we obtain the following 
dispersion relations u(k) from the condition of a non-trivial solvability of the 
corresponding linear system with respect to Uk and p^: 

c j± = — -k 2 dz -i\k\\/Ak 2 - 15 , (8-17) 

o o 

for the Navier-Stokes approximation, 

2 ^ 

uj± = —~k 2 ± -i\k\\Z%k 2 + 15 , (8.18) 

o o 

for the Burnett approximation (8.15), and 

uj± = ^ k 2 (k 2 - 3) ± li|fc|\M 6 - 24fc 4 - 72fc 2 - 135 , (8.19) 

for the super-Burnett approximation (8.16). 

These examples demonstrate that the real part Re(a;±(fc)) < 0 for the 
Navier-Stokes (8.17) and for the Burnett (8.18) approximations, for all wave 
vectors. Thus, these approximations describe attenuating acoustic waves. 
However, for the super-Burnett approximation, the function Re(uj±(k)) (8.19) 





8.3 Exact Summation of the Chapman-Enskog Expansion 197 


becomes positive as soon as \k\ > y/3. That is, the equilibrium point is sta¬ 
ble within the Navier-Stokes and the Burnett approximation, and it becomes 
unstable within the super-Burnett approximation for sufficiently short waves. 
Similar to the case of the Bobylev instability of the Burnett hydrodynam¬ 
ics for the Boltzmann equation, the latter result contradicts the dissipative 
properties of the Grad system (8.10): the spectrum of the full IDIOM system 

(8.10) is stable for arbitrary k. 

Our goal now is to sum up the series (8.11) in closed form. Firstly, we 
should make some preparations. 

As demonstrated in [43] (see also below), the functions cr^ in (8.11) and 
(8.12) have the following explicit structure to arbitrary order n > 0: 

a (2n) = a n d 2 x n+1 u , (8.20) 

0 .(2n+i) = bnd 2(n+l) p ? 

where the coefficients a n and b n are determined through the recurrence pro¬ 
cedure (8.12), and (8.13). The Chapman-Enskog procedure (8.12) and (8.13) 
can be represented in terms of the real-valued coefficients a n and b n (8.20). 

Knowing the structure (8.20) of the coefficients of the Chapman-Enskog 
expansion (8.11), we can write down its formal sum. It is convenient to use the 
Fourier variables introduced above which amounts essentially to the change 
ed x —> ik. Substituting expression (8.20) into the Chapman-Enskog series 

(8.11) , we obtain the following formal expression for the Fourier image of the 
sum: 

cr/c = ikA(k 2 )uk — k 2 B(k 2 )pk , (8.21) 

where the functions A(k 2 ) and B(k 2 ) are formal power series with the coef¬ 
ficients (8.20): 


A(k 2 ) = ] 'Ta n (-k 2 ) n , 

n =0 
oo 

B{k 2 ) = Y J K{~k 2 ) n . 


( 8 . 22 ) 


n —0 


Thus, the question of the summation of the Chapman-Enskog series (8.11) 
amounts to finding the two functions, A{k 2 ) and B(k 2 ) (8.22). Knowing them, 
the dispersion relation for the hydrodynamic modes can be derived: 


u± = J fA ± My fc 2 A 2_| (1 _ fc2jB) 


(8.23) 


We shall concentrate now on the problem of deriving A{k 2 ) and B(k 2 ) 
(8.22) in closed form. For this purpose, we shall first express the Chapman- 
Enskog procedure (8.12) and (8.13) in terms of the coefficients a n and b n 
(8.20). At the same time, our derivation will constitute proof for the structure 
(8.20). 
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It is convenient to start with the Fourier representation of (8.12) and 
(8.13). Writing u = Uk exp(i/cx), p = pk exp(zfcx), and a = cr& exp(ifcx), we 
obtain: 


while 


and 


o(m) 

u k 

d im) 
t Pk 


{ 

{ 


—ikpki m = 0 

— m > 1 

— ^ikuk, m = 0 

0, m > 1 ’ 


n—1 

E™) _ o( m )^( n “ 1 “ m ) 

a /c - °t a k 

m =0 


cr[ 2ra) = a n (-k 2 ) n iku k , 
4 2 " +1) = K{-k 2 ) n {-k 2 )p k . 


(8.24) 


(8.25) 


(8.26) 


The Navier-Stokes and the Burnett approximations give ao = — |, and bo = 
— Thus, the structure (8.26) is proved for n = 0. 

The further derivation relies on induction. Let us assume that the ansatz 
(8.26) is proven up to the order n. Computing the coefficient cr ^, 2( ' n+1 ^ from 
(8.25), we have: 


(2(n+l)) _ _o(0) _(2n+l) _ o(2m+l) (2(n-m)) _ n(2m) (2(n-m) + l) 

a /c — °t a k Ut a k / , °t a k 

m=0 m=l 

(8.27) 

Due to the assumption of the induction, we can adopt the form of the coeffi¬ 
cients (8.26) in all the terms on the right hand side of (8.27). On the basis 
of (8.26) and (8.24), we conclude that each term in the last sum of (8.27) is 
equal to zero. Further, the term gives the linear contribution: 

d (o) a (2 n +i) = d t (0) &„(-fc 2 )”(_fc 2 )p fc = b n {-k 2 ) n+ 1 iku k , 

while the terms in the remaining sum contribute nonlinearly: 
a (2m+l) (7 (2(n- m )) =aji _ m( _ A ,2)„- m . A , a (2m+l) Ufc = _ a n - m a m (-k 2 ) n+ Hku k . 

Substituting the last two expressions into (8.27), we see that it has just the 
same structure as the coefficient cr^ n+1 ^ in (8.26). Thus, we obtain the first 
recurrence equation: 


^n+l — t^n 


n 

E 

m =0 
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Computing the coefficient cr ^ n+1 ^ )+1 ) by the same pattern, we come to the 
second recurrence equation, and the Chapman-Enskog procedure (8.12) and 
(8.13) can be reformulated in terms of the coefficients a n and fr n (8.20): 


^n+l q T ^ ^ ^n—m&m •> 

m =0 


b n +1 — &n+l + E ^n—mAn 

m =0 


(8.28) 


The initial condition for this set of equations is dictated by the Navier-Stokes 
and the Burnett terms: 



Our goal now is to compute the functions A and B (8.22) on the basis of 
the recurrence equations (8.28). At this point, it is worthwhile to notice that 
the usual way of dealing with the recurrence system (8.28) would be either 
to truncate it at a certain n, or to calculate all the coefficients explicitly, 
and substitute the result into the power series (8.22). Both approaches are 
not successful here. Indeed, retaining the coefficients ao, fro, an d gives 
the super-Burnett approximation (8.16) which has the Bobylev short-wave 
instability, and there is no guarantee that the same failure will not occur in 
the higher-order truncation. On the other hand, a term-by-term computation 
of the whole set of coefficients a n and fr n is a nontrivial task due to the 
nonlinearity in (8.28). 

Fortunately, another route is possible. Multiplying both the equations in 
(8.28) with (—& 2 ) n+1 , and performing a formal summation in n from zero to 
infinity, we arrive at the following expressions: 


{ _ oo n 

+ a n - m (-k 2 ) n - m a m (-k 2 ) m 

n =0 m =0 
oo n 

B - bo = A - a 0 - k 2 Y, E a n - m (-k 2 ) n - m b m (-k 2 ) m 

n =0 m =0 

Now we notice that 

N n 

Jim T T a n _ m (-k 2 ) n ~ m a m (-k 2 ) m 

N^-oc ‘ ' 

n =0 m =0 

N n 

lim T T a n _ m (-k 2 ) n ~ m b m (-k 2 ) m 

oo ^—' *—' 

n =0 m =0 


= A 2 , 
= AB . 


(8.30) 


(8.31) 


Taking into account the initial condition (8.29), equation (8.30) yields a pair 
of coupled quadratic equations for the functions A and B: 
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A = -^-k 2 (^B + A 2 ^ , (8.32) 

B = A(l-k 2 B) . 

The result (8.32) concludes essentially the question of the computation of 
functions A and B (8.22). Still, further simplifications are possible. In partic¬ 
ular, it is convenient to reduce the consideration to a single function. Solving 
system (8.32) for £?, and introducing a new function, X(k 2 ) = k 2 B{k 2 ), we 
obtain an equivalent cubic equation: 

-l ix - lf (x + i) = §. (8.33) 

Since A and B (8.22) are real-valued, we are only interested in the real-valued 
roots of (8.33). 

An elementary analysis of this equation brings the following result: the 
real-valued root X(k 2 ) of (8.33) is unique and negative for all finite values 
k 2 . Moreover, the function X{k 2 ) is a monotonic function of k 2 (Fig. 8.1). 
The limiting values are: 

lim X(k 2 ) = 0 , lim X(k 2 ) = -0.8 . (8.34) 

|/c|—►() | k | — >oo 

Under the conditions just mentioned, the function under the root in (8.23) 
is negative for all values of the wave vector fc, including the limits, and we 
come to the following dispersion law: 



Fig. 8.1. Real-valued root of (8.33) as a function of k 2 
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|fc| / 5X 2 — 16X + 20 


3 


(8.35) 


where X = X(k 2 ) is the real-valued root of equation (8.33). Since X(k 2 ) 
is negative for all \k\ > 0, the attenuation rate, Re(cj±), is negative for all 
\k\ >0, and the exact acoustic spectrum of the Chapman-Enskog procedure 
is stable for arbitrary wave lengths. In the short-wave limit, from (8.35) we 
obtain: 



(8.36) 


| k | —>oo 9 

The characteristic equation of the original Grad equations (8.10) reads: 


3w 3 + 3w 2 + 9 k 2 uj + 5fc 2 = 0 . 


(8.37) 


The two complex-conjugate roots of this equation correspond to the hydrody¬ 
namic modes, while for the non-hydro dynamic real mode, (v n h(k ), u n h( 0 ) = 
— 1, and (v n h —> —0.5 as |fc| —» oo. Recall that the non-hydrodynamic modes of 
the Grad equations are characterized by the common property that for them 
cj(0) 7 ^ 0. These modes are irrelevant to the Chapman-Enskog method. As 
the final comment here, (8.36) demonstrates that the exact attenuation rate, 
Re(a;±), tends to a finite value, — | ~ —0.22 as \k\ —► oo. This asymptotic 
behavior is in a complete agreement with the data for the hydrodynamic 
branch of the spectrum (8.37) of the original Grad equations (8.10). The 
attenuation rates (real parts of the dispersion relations (j± for the Burnett 
(8.18), the super-Burnett (8.19), the exact Chapman-Enskog solution (8.35), 
are compared to each other in Fig. 8.2. In this figure, we also represent the 
attenuation rates of the hydrodynamic and non-hydrodynamic mode of the 
Grad equations (8.37). The results of this section lead to the following con¬ 
clusion: 

(i) The proposed approach provides a way to deal with the problem of 
summation of the Chapman-Enskog expansion. The exact dispersion relation 
(8.35) of the Chapman-Enskog procedure is demonstrated to be stable for 
all wave lengths, while the Bobylev instability is present on the level of the 
super-Burnett approximation. Moreover, it can be demonstrated that the 
function X (the real root of (8.33)) is a real-valued analytic function of k. 
Thus, the treatment of the formal expansions performed above is justified. 

(ii) The exact result of the Chapman-Enskog procedure has a clear non¬ 
polynomial character. Indeed, this follows directly from (8.34): the function 
X(k 2 ) cannot be a polynomial because it maps the axis k into a segment 
[ 0 , — 0 . 8 ]. As a conjecture here, the resulting exact hydrodynamics is essen¬ 
tially nonlocal in space. For this reason, even if the hydrodynamic equations 
of a certain level of the approximation is stable, it cannot reproduce the 
non-polynomial behavior for sufficiently short waves. 
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Fig. 8.2. Attenuation rates for the IDIOM Grad system. Solid : Exact summa¬ 
tion of the Chapman-Enskog Expansion. Dots : The Navier-Stokes approxima¬ 
tion. Dash : The super-Burnett approximation. Circles : Hydrodynamic and non¬ 
hydrodynamic modes of the IDIOM Grad system 


(iii) The result of this section demonstrates that, at least in some cases, 
the sum of the Chapman-Enskog series amounts to a quite regular function, 
and the “smallness” of the Knudsen number e used to develop the Chapman- 
Enskog procedure (8.12) is no longer necessary. 


8.3.2 The 3D10M Grad Equations 

In this section we generalize our considerations of the Chapman-Enskog 
method to the three-dimensional linearized 10-moment Grad equations [201]. 
The Chapman-Enskog series for the stress tensor, which is again due to a 
nonlinear procedure, will be summed up in closed form. The method used fol¬ 
lows essentially the one discussed above, though the computations are slightly 
more extensive. The reason to consider this example is that we would like to 
know what happens to the diffusive hydrodynamic mode in the short-wave 
domain. 

Throughout this section, we use the variables (8.1), and p and u are 
dimensionless deviations of pressure and of mean flux from their equilibrium 
values, respectively. The point of departure is the set of the three-dimensional 
linearized Grad equations for the p, u, and tr, where a is a dimensionless 
stress tensor: 
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(8.38) 

d t u = — Vp — V • cr , 

d(a = -Vn — -cr . 

e 

Equation (8.38) provides a simple model of a coupling of the hydro- 
dynamic variables, u and p, to the non-hydrodynamic variable a. These 
equations are suitable for an application of the Chapman-Enskog procedure. 
Therefore, our goal here is not to investigate the properties of (8.38) as they 
are, but to reduce the description, and to get a closed set of equations with 
respect to the variables p and u only. That is, we have to express cr in terms 
of spatial derivatives of p and of u. The Chapman-Enskog method, as applied 
to (8.38) results in the following: 

oo 

a = e n+ V") . (8.39) 

n=0 

The coefficients cr ^ are due to the following recurrence procedure: 

n— 1 

a (n) = _J2 , ( 8 . 40 ) 

m =0 


where the Chapman-Enskog operators d\ m> act on the functions p and u, 
and on their derivatives, as follows: 


d ( t m) Du 

d[ m) Dp 


f — DVp , m = 0 

\-.DV-cr^- 1 ), to > 1 

( —|DV ■ u, to = 0 

| 0 , rri > 1 


(8.41) 


Here D is an arbitrary differential operator D = n?=i while U is an 
arbitrary integer, and d® = 1. Finally, = -Vu, which leads to the 

Navier-Stokes approximation. 

Our goal is to sum up the series (8.39) in closed form. 

The terms a^ in equations (8.39), (8.40), and (8.41), have the following 
explicit structure for arbitrary order n > 0 (a generalization of (8.20) to the 
three-dimensional case): 

cr (2n) = a n A n Wu + bnA^GV • u , (8.42) 

<r<2"+i) = c n A n Gp , 


where A = V • V is the Laplace operator, and the operator G has the form: 

G = VV - \lA = 4W . 

o Zt 


(8.43) 


204 8 Hydrodynamics From Grad’s Equations: Exact Solutions 


The real-valued and yet unknown coefficients a n , fr n , and c n in (8.42) are 
due to the recurrence procedure (8.40), and (8.41). Knowing the structure of 
the coefficients of the Chapman-Enskog series (8.42), we can reformulate the 
Chapman-Enskog solution in terms of a self-consistent recurrence procedure 
for the coefficients a n , b n , and c n . Let us consider this derivation in more 
detail. 

The point of departure is the Fourier representation of the recurrence 
equations (8.40), (8.41), and (8.42). Writing 


u = Uk exp (ik • x) , 

P = Pk exp (ik • x) , 
cr( n ) = a^ exp (ik • x) , 

and introducing the unit vector e k directed along k (fe = fee*,), equations 
(8.40), (8.41), and (8.42) can be rewritten as: 


n— 1 

°l n) = -£ , ( 8 - 44 ) 

m =0 


di m) D k u k = 
d\ m) D kPk = 


-D k ikp k , m = 0 

—D k ik • m > 1 

— | D k ik • nfe, m = 0 

0 , m > 1 


where .D/c is an arbitrary tensor D k = and 

cr fc 2n) = {~k 2 ) n {a n iku + b n ig k (k • it)) , 

o{ 2 " +1) = c„(-fc 2 ) n+1 Sf fe p fc , 


(8.45) 


(8.46) 


where 


9k = 


( 1 


1 _ 

= -j^kek • 


(8.47) 


From the form of the Navier-Stokes approximation, cr^\ it follows that 
ao = — 1 and bo = 0, while a direct computation of the Burnett approximation 
leads to: 



(8.48) 


Thus, we have Co = — ^which proves the ansatz (8.42) for n = 0 in both the 
even and the odd orders. 

The rest of the proof relies on induction. Let the structure (8.46) be 
proven up to the order n. The computation of the next, n + l order coefficient 
<T £ 2 ( n+1 )), i nv °l ves only terms of lower order. From (8.44) we obtain: 
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2n+l 

(2(n+l)) _ q( 0) (2n+l) pXm) (2n+l-m) 

a k — a k °t a k 

m =1 


(8.49) 


The first term in the right hand side depends linearly on the coefficients c n : 

- 0< o) «7< 2n+1) = -c n (-k 2 ) n+1 g k dj; 0) p k (8.50) 

= 7 ^ c n(—k 2 ) n+1 ig k k ■ u k . 

The remaining terms on the right hand side of (8.49) contribute nonlinearly. 
Splitting the even and the odd orders of the Chapman-Enskog operators 
d^ m \ we rewrite the sum in (8.49): 


2n+l n n 

- 52 g(m)^n+l-m) _ _ yv g(2l) ^(n-Q+l) _ ^ g(2l+l)^(n-l)) 

m =1 1=1 1=0 

(8.51) 

Due to (8.46) and (8.45), each term in the first sum is equal to zero, and we 
are left only with the second sum: 


d[ 2l+1) a {2{n l)) = ( -k 2 ) n 1 (a n -iikd[ 2l+1) u k +b n -iig k k-d\ 2l+1) u k ) , (8.52) 
while 

(a t + 2bi)e k (e k ■ u k )) . (8.53) 


d[ 2l+1) u k = -(-k 2 ) l+1 (^aiu k + 1 


In the last expression, use of the following identities was made: 


fc • ku k = k 2 [u k + ^e k (e k • u fc ) ) , 


(8.54) 


k g k = -k . 


Substituting (8.53) into the right hand side of (8.52), and thereafter substi¬ 
tuting the result into the right hand side of (8.51), we obtain the following 
in the right hand side of (8.49): 


r (2(n+i)) = (_^2)n+i a n _ m a m ^ iku k + ( -k 2 ) n+1 (pCn (8.55) 


T ^ ^ ^(2c&n —m T b n — T 26 m ) T <x n — m b m | ig k (k • u k ^) . 


•}) is 


The functional structure of the right hand side of this expression is the same 
as that of the first equation in the set (8.46), and thus we obtain the first 
recurrence equation: 




206 8 Hydrodynamics From Grad’s Equations: Exact Solutions 


Q j n+ik'u , k -\- b n j r \g k {k • li/c) — E ku k 


\m =0 


3 C " 


■±{i 

m =0 k 


^ (2« n -m T bn—rri) (^m T 26 m ) T 


}) 


(8.56) 
9k( k ‘ u k) ■ 


Considering in the same way the coefficient cr^ n+1 ^ +1 t we come to the 
second recurrence equation, 


2 . \ 

Gi+i = 2a n+ i H- ^n+i T x ^ ^ (2a n -m T b n —m)( 


m=0 


(8.57) 


Thus, the complete set of the recurrence equations is given by (8.56) and 
(8.57). Equation (8.56) is equivalent to a pair of scalar equations. Indeed, 
introducing new variables, 

2 

r n = gC n , (8.58) 

2 

Qn = E ^ n ) 5 

and using the identity, 


fcU/e = (feu* - 20 /c (fc • U k )) + 20 /c (fc • W fe ) , 


and also noticing that 


9k : ( ku k - 2g k ( k ■ u k )) = 0 , 

where : denotes the double contraction of tensors, we arrive in (8.56) and 
(8.57) at the following three scalar recurrence relations in terms the coeffi¬ 
cients r n , g n , and a n : 


^n+l — ^n+1 T ^ ^ Qn—r 


m =0 


n 


^n+1 — T ^ ^ Qn—r 


iQm 


^n+1 — ^ ^ (In — 


m =0 

m a m 


m =0 


(8.59) 


The initial condition for this system is provided by the explicit form of the 
Navier-Stokes and the Burnett approximations, and reads: 


r 0 = -4/3, q 0 = -4/3, a 0 = -1 . 


(8.60) 
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The recurrence relations (8.59) are completely equivalent to the original 
Chapman-Enskog procedure (8.40) and (8.41). In the one-dimensional case, 
the recurrence system (8.59) reduces to the first two equations for r n and q n . 
In this case, the system of recurrence equations is identical (up to the nota¬ 
tions) to the recurrence system (8.28), considered in the preceding section. 
For what follows, it is important to notice that the recurrence equation for 
the coefficients a n is decoupled from the equations for the coefficients r n and 
Qn- 

Now we shall express the Chapman-Enskog series of the stress tensor 
(8.39) in terms of r n , g n , and a n . Using again the Fourier transform, and 
substituting (8.42) into the right hand side of (8.39), we derive: 

cr k = A(k 2 )(ku k -2g k (k-u k )) + '^Q(k 2 )g k (k-u k )-'^k 2 R(k 2 )g k p k , (8.61) 

From here on, we use a new spatial scale which amounts to k! — ek , and 
drop the prime. The functions A(k 2 ), Q(k 2 ), and R(k 2 ) in (8.61) are defined 
by the power series with the coefficients due to (8.59): 

oo 

A(k 2 ) = Y J dn(-k 2 ) n , (8.62) 

n =0 
oo 

Q(k 2 ) = 5>„(-fc 2 )" , 

n =0 
oo 

R(k 2 ) = r n (—k 2 ) n . 

n =0 

Thus, the question of summation of the Chapman-Enskog series (8.39) 
amounts to finding the three functions, A = A(k 2 ), Q = Q(k 2 ), and R = 
R(k 2 ) (8.62) in the three- and two-dimensional cases, or to the two functions, 
Q(/c 2 ), and R(k 2 ) in the one-dimensional case. 

Now we shall focus on computing the functions (8.62) from the recurrence 
equations (8.59). At this point, it is worthwhile to notice again that a trun¬ 
cation at a certain n is not successful. Indeed, already in the one-dimensional 
case, retaining the coefficients go, Up and gi leads to the super-Burnett ap¬ 
proximation (8.16) which has the short-wave instability for k 2 > 3, as it was 
demonstrated in the preceding section, and there is no guarantee that the 
same will not occur in a higher-order truncation. 

Fortunately, the approach introduced in the preceding section works 
again. Multiplying each of the equations in (8.62) with (—& 2 ) n+1 , and per¬ 
forming a summation in n from zero to infinity, we derive: 


Q - qo = ~k 2 


+ E E Qn- m (-k 2 ) n - m q m (-k 2 Y 


n =0 m —0 


(8.63) 
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R-r 0 = Q-q 0 -k 2 J2Yl Qn-m(-k 2 ) n - m r m (-k 2 ) m , 
n=0 rn=0 

oo n 

A- ao = -k 2 J2J2 a n -m(-k 2 ) n - m a m (-k 2 ) m . 
n= 0 m= 0 

Now we notice that 

N n 

lim V V a n . m (-k 2 ) n - m a m (-k 2 ) m = A 2 , (8.64) 

N—>oc c ^ ^ 

n= 0 m= 0 

N n 

lim W W q n -m(-k 2 ) n ~ m r m (-k 2 ) m = QR , 

N —XX) * ^ ‘ ** 

n= 0 m= 0 

N n 

Jim W W qn-m(-k 2 ) n ~ m qm(-k 2 ) m = Q 2 ■ 

iV—XX Z ' Z —' 

n= 0 m=0 

Taking into account the initial conditions (8.60), and also using (8.64), we 
derive from (8.63) the following three quadratic equations for the functions 
A, i?, and Q: 

Q = -\-k 2 (^-R + Q 2 ^j , (8.65) 

R = Q( 1 - k 2 R) , 

The result (8.65) concludes essentially the question of computation of func¬ 
tions (8.62) in closed form. Still, further simplifications are possible. In par¬ 
ticular, it is convenient to use a single unknown function, X(k 2 ) = k 2 R(k 2 ), 
in the first two equations in the system (8.65). We again obtain an equivalent 
cubic equation: 

- b -(X-l) 2 {X + \) = p, (8.66) 

which coincides with (8.66) of the previous section. We shall also rewrite the 
third equation of (8.65) using a function Y(k 2 ) = k 2 A(k 2 ): 

y(l + y) = -k 2 . (8.67) 

The functions in (8.62) can now be straightforwardly expressed in terms 
of the relevant solutions to (8.66) and (8.67). Since all functions in (8.62) are 
real-valued functions, we are interested only in the real-valued roots of the 
algebraic equations (8.66) and (8.67). 

The relevant analysis of the cubic equation (8.66) was already performed 
above: the real-valued root X{k 2 ) is unique and negative for all finite values 
of k 2 . Limiting values of the function X(k 2 ) at k —> 0 and at k —> oc are 
given by (8.34): 
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lim X(k 2 ) = 0 , lim X{k 2 ) = — - . 

/c —>0 k — >oo 5 

The quadratic equation (8.67) has no real-valued solutions for k 2 > 
and it has two real-valued solution for each k 2 , where k 2 < \. We denote 
k c = \ the corresponding critical value of the wave vector. For k — 0, one of 
these roots is equal to zero, while the other is equal to one. The asymptotics 
Y —> 0, as k —> 0, answers the question which of these two roots of (8.67) is 
relevant to the Chapman-Enskog solution, and we derive: 


Y = 


(1-Vl-4fc 2 ) k < k c 

none k > k c 


( 8 . 68 ) 


The function Y (8.68) is negative for k < k c . 

From now on, X and Y will denote the relevant roots of (8.66) and (8.67) 
just discussed. The Fourier image of the expression V • cr follows from (8.61): 

ik ■ cr k = Y((e k ■ u k )e k - u k ) - - -— (e fe • u k )e k - iXkp k . (8.69) 

1 — A 

The latter expression contributes to the right-hand side of the second of 
equations in the Grad system (8.38) (more specifically, it contributes to the 
corresponding Fourier transform of this equation). Knowing (8.69), we can 
calculate the dispersion u(k) of the plane waves ^exp {uot + ik • x} which 
now follows from the exact solution of the Chapman-Enskog procedure. The 
calculation of the dispersion relation amounts to an evaluation of the deter¬ 
minant of a (d + 1) x (d + 1) matrix, and is quite standard (see, e.g. [240]). 
We therefore provide only the final result. The exact dispersion relation of 
the hydrodynamic modes reads: 

(" - Yf- 1 (u 2 - + b -e(l -X)^j= 0 . (8.70) 

Here, d is the spatial dimension. 

From the dispersion relation (8.70), we easily derive the following classi¬ 
fication of the hydrodynamic modes: 

(i) For d— 1, the spectrum of the hydrodynamic modes is purely acoustic 
with the dispersion uj a which is given by (8.35): 

X , .k IbX 2 - 16X + 20 

Wa “ 2(1-X) ±l 2 V 3 

where X = X(k 2 ) is the real-valued root of (8.66). Since X is a negative 
function for all k > 0, the attenuation rate of the acoustic modes, Re(o; a ), 
is negative for all k > 0, and the exact acoustic spectrum of the Chapman- 
Enskog procedure is free of the Bobylev instability for arbitrary wave lengths. 
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(ii) For d > 1 , the dispersion of the acoustic modes is given by (8.71). As 
follows from the Chapman-Enskog procedure, the diffusion-like (real-valued) 
mode has the dispersion 




— \ (l — \/l — 4/c 2 ) k < k c 
none k > k c 


(8.72) 


The diffusion mode is (d — 1) times degenerated, the corresponding attenu¬ 
ation rate is negative for k < fc c , and this mode cannot be extended beyond 
the critical value k c = \ within the Chapman-Enskog method. 

The reason why this rather remarkable peculiarity of the Chapman- 
Enskog procedure occurs can be found upon closer investigation of the spec¬ 
trum of the underlying Grad moment system (8.38). 

Indeed, in the original system (8.38), besides the hydrodynamic modes, 
there exist several non-hydrodynamic modes which are irrelevant to the 
Chapman-Enskog solution. All these non-hydro dynamic modes are charac¬ 
terized by the property that the corresponding dispersion relations u(k) do 
not go to zero, as k —> 0. At the point k c = the diffusion branch (8.72) 
intersects with one of the non-hydro dynamic branches of (8.38). For larger 
values of the wave vector fc, these two branches produce a pair of complex con¬ 
jugate solutions with the real part equal to — Thus, though the spectrum of 
the original equations (8.38)indeed continues past & c , the Chapman-Enskog 
method does not recognize this extension as part of the hydrodynamic branch. 
It is also interesting to notice that if we would accept all the roots of (8.67), 
including the complex-values for k > fc c , and not only the real-valued root 
as suggested by the asymptotics of the Chapman-Enskog solution (see the 
explanations preceding (8.68)), then we would come in (8.70) to the structure 
of the dispersion relation just mentioned. 

The attenuation rates (the functions Re(cj a ) and Re(cJd)) are plotted in 
Fig. 8.3, together with the relevant dependencies for the approximations 
of the Chapman-Enskog method. The non-hydro dynamic branch of (8.38) 
which causes the breakdown of the Chapman-Enskog solution is also repre¬ 
sented in Fig. 8.3. It is rather remarkable that while the exact hydrodynamic 
description becomes inapplicable for the diffusion branch at fc > fc c , the usual 
Navier-Stokes description still provides a good approximation to the acoustic 
mode around this point. 

The analysis of this section leads to the following additional remarks to 
the conclusions made at the end of Sect. 8.3.1: 

(i) The developed approach provides an understanding of the features 
of Chapman-Enskog solutions and the problem of extending the hydrody¬ 
namic modes into a highly non-equilibrium domain on the exact basis and 
in the full spatial dimension. The exact acoustic mode in the framework of 
the Chapman-Enskog procedure is demonstrated to be stable for all wave 
lengths, while the diffusion-like mode can be regarded for the hydrodynamic 
mode only in a bounded domain k < k c . It is remarkable that the result of the 



8.3 Exact Summation of the Chapman-Enskog Expansion 211 



Fig. 8.3. Attenuation rates for the 3D10M Grad system as functions of \k\. Bold : 
The acoustic branch, exact summation. Dots : The acoustic branch, Navier-Stokes 
approximation. Circles : The acoustic branch, super-Burnett approximation. Solid : 
The diffusion branch, exact summation. Dash : The critical mode of the 3D10M 
Grad system 


Chapman-Enskog procedure has a clear non-polynomial character. As a con¬ 
jecture here, the resulting hydrodynamics is essentially nonlocal in space. It 
is also clear that any polynomial approximation to the Chapman-Enskog se¬ 
ries will fail to reproduce the peculiarity of the diffusion mode demonstrated 
in the framework of the exact solution. 

(ii) Concerning the extension of hydrodynamics into a highly non-equili¬ 
brium domain on the basis of the Boltzmann equations, the question remains 
open in the sense of an exact summation as above. In this respect, results 
for simplified models can serve either for testing approximate procedures 
or at least as guide. In particular, the mechanism of the singularity of the 
diffusion-like mode through a coupling to the non-hydro dynamic mode might 
be a rather general mechanism of limiting of the hydrodynamic description, 
and not just a feature of the Grad systems. 

(iii) The result of this section demonstrates that the sum of the Chapman- 
Enskog series amounts to either a quite regular function (as is the function 
X), or to a function with a singularity at finite k c . In both cases, however, the 
“smallness” of the Knudsen number e used to develop the Chapman-Enskog 
procedure plays no role in the result of the Chapman-Enskog procedure. 
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8.4 The Dynamic Invariance Principle 

8.4.1 Partial Summation of the Chapman—Enskog Expansion 

The examples considered above demonstrate that it makes sense to speak 
about the sum of the Chapman-Enskog expansion, at least when the Chap- 
man-Enskog method is applied to the (linearized) Grad equations. However, 
even in this case, the possibility to perform the summation exactly seems to be 
the lucky exception rather than the rule. Indeed, computations become more 
bulky with the increase of the number of the moments included in the Grad 
equations. Therefore, we arrive at the question: how can we approximate the 
recurrence equations of the Chapman-Enskog method to account for all the 
orders in the Knudsen number? Any such method amounts to some “partial” 
summation of the Chapman-Enskog expansion, and this type of working with 
formal series is widely spread in various fields of physics. 

In this section we shall discuss a method of approximating the Chapman- 
Enskog expansion as a whole. As we now have the exact expressions for the 
Chapman-Enskog solution for the linearized 10 moment Grad equations, it 
is natural to start with this example for comparison purposes. 

Let us come back to the originating one-dimensional Grad equations 
(8.10), and to the corresponding formulas of the Chapman-Enskog method 
(8.12) and (8.13). Instead of using the exact equations (8.12) in each order 
n, we introduce the following approximate equations: 

Let N > 1 be some fixed integer. Then, instead of equations (8.12), we 
write: 


n —1 


CT (n) = _J2 0 t (ro) <7 (n_1_m \ 

n < N , 

(8.73) 

m =0 



N—l 



a (n) = _^ 

n > N . 

(8.74) 


m =0 


This approximation amounts to the following: up to order AT, the Chapman- 
Enskog procedure (8.12) is taken exactly (equation (8.73)), while in the 
computation of higher orders (equation (8.74)) we restrict the set of the 
Chapman-Enskog operators (8.13) only up to order N. Thus, the Chapman- 
Enskog coefficients of order higher than N are taken into account only 
“partially”. As N tends to infinity, the recurrence procedure (8.73) and (8.74) 
tends formally to the exact Chapman-Enskog procedure (8.12). We shall fur¬ 
ther refer to (8.73) and (8.74) as the regularization of the N — th order. In 
particular, taking N = 1, we come to the regularization of the Burnett ap¬ 
proximation, taking N = 2 we come to the regularization of the super-Burnett 
approximation, etc. 

It can be demonstrated that the approximate procedure just described 
does not alter the structure of the functions cr^ 2n ^ and cr( 2n+1 ) (8.20), while 
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the recurrence equations for the coefficients a n and b n (8.20) will differ from 
the exact result of the full Chapman-Enskog procedure (8.28). The advantage 
of the regularization procedure (8.73) and (8.74) over the exact Chapman- 
Enskog recurrence procedure (8.12) is that the resulting equations for the 
coefficients a n and b n are always linear, as they result from (8.73) and (8.74). 
This feature enables one to sum up the corresponding series exactly, even 
if the originating nonlinear procedure leads to a too difficult analysis. The 
number N can be called the “depth” of the approximation: the large N is, 
the more low-order terms of the Chapman-Enskog expansion are taken into 
account exactly due to (8.73). 

For the first example, let us take N = 1 in (8.73) and (8.74). The regu¬ 
larization of the Burnett approximation then reads: 

a (") = -dfV"- 1 ) , (8.75) 

where n > 1, and a* 0 * = —(4/3 )d x u. Turning to the Fourier variables, we 
derive: 


= a n (-k 2 ) n iku k , (8.76) 

4 2n+1) = b n (-k 2 ) n+1 p k , 


where the coefficients a n and b n are due to the following recurrence procedure: 

5 4 

^n+l = = = ^ ’ (8.77) 


whereupon 



(8.78) 


Thus, denoting as a^ k the Fourier transform of the regularized Burnett ap¬ 
proximation, we obtain: 


R _ 
°ik — 


3 + 5 k 2 


(iku k - k 2 p k ) 


(8.79) 


It should be noted that the recurrence equations (8.77) can also be ob¬ 
tained from the exact recurrence equations (8.28) by neglecting the nonlinear 
terms. Thus, the approximation adopted within the regularization procedure 
(8.75) amounts to the following rational approximation of the functions A 
and B (8.22): 


Af = B 


R 

1 


4 

3 + 5fc 2 ' 


(8.80) 


Substituting the latter expressions instead of the functions A and B in the 
dispersion formula (8.23), we come to the dispersion relation of the hydrody¬ 
namic modes within the regularized Burnett approximation: 
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2 k 2 /75fc 2 Jfc 2 + 66fc 2 + 15 

U± ~ ~3 + 5 k 2 2hk 2 k 2 + 30/c 2 + 9 


(8.81) 


The dispersion relation (8.81) is stable for all wave vectors, and in the short¬ 
wave limit we have: 

lim uj± = — 0.4 dz i\k\V3 . (8.82) 

| k | —>oo 

Thus, the regularized Burnett approximation leads qualitatively to the 
same behavior of the dispersion relation, as the exact result (8.36), with the 
limiting value of the attenuation rate equal to —0.4 instead of the exact value 
-2/9. 

Consider now the regularization of the super-Burnett approximation. This 
amounts to setting TV = 2 in the recurrence equations (8.73) and (8.74). Then, 
instead of (8.75), we have: 


a 


= -d t (C V°) , 

(2+n) _ a (n+l) _ 


(8.83) 


where n > 0. The corresponding recurrence equations for the coefficients a n 
and b n now become: 


^n+i — 3^ n ’ ^ n — 0 • (8.84) 

Thus, instead of (8.80), we obtain: 

A ? = B? = - ■ (8^85) 

The corresponding dispersion relation of the regularized super-Burnett ap¬ 
proximation reads: 


2 k 2 \2hk 2 k 2 + 78/c 2 +45 

W± “ 3fc 2 fc 2 + 18fc 2 + 27 ’ 

while in the short-wave limit the asymptotic behavior becomes: 


lim uj± = —2±i\k\ 



( 8 . 86 ) 


(8.87) 


The Bobylev instability is removed again within the regularization of the 
super-Burnett approximation, and the lower-order terms of the Chapman- 
Enskog expansion are taken into account more precisely in comparison to the 
regularized Burnett approximation. However, the approximation in a whole 
has not improved (see Fig. 8.4). Thus, we can conclude that although the par¬ 
tial summation method (8.73) and (8.74) is capable of removing the Bobylev 
instability, and reproducing qualitatively the exact Chapman-Enskog solution 









8.4 The Dynamic Invariance Principle 215 



Fig. 8.4. Attenuation rates for the partial summing. Solid : The regularized Burnett 
approximation. Dash : The regularized super-Burnett approximation. Circles : The 
super-Burnett approximation. Dots : The exact summation 


in the short-wave domain, the exactness does not increase monotonically with 
the depth of the approximation N. This drawback of the regularization proce¬ 
dure indicates once again that an attempt to capture the lower-order terms of 
the Chapman-Enskog procedure does not succeed in a better approximation 
as a whole. 


8.4.2 The Dynamic Invariance 

The starting points of all the approaches considered so far (exact or ap¬ 
proximate) is the Chapman-Enskog expansion. However, the result of the 
summation does not involve the Knudsen number e explicitly and does not 
require the “smallness” of this parameter. Therefore, it makes sense to refor¬ 
mulate the problem of the reduced description (for the Grad equations (8.10) 
this amounts to the problem of constructing a function cr k (u k ,p k , &)) in a 
way where the parameter e does not appear at all. Further, in the framework 
of such an approach, we can seek a method of explicit construction of the 
function cr k (u k ,p k , &), which does not rely upon the Taylor-like expansions 
as above. 

In this section we introduce such an approach, considering again the illus¬ 
trative example (8.10). These ideas will be extensively used in the sequel, and 






216 8 Hydrodynamics From Grad’s Equations: Exact Solutions 


they also constitute the basis of the so-called method of invariant manifold 
for dissipative systems [11]. 

Let us rewrite here (8.10) in the Fourier variables, and cancel the para¬ 
meter e: 

5 

dtPk = -~ikui e , (8.88) 

d t u k = -ikpk - ika k , 
d t Vk = ~-iku k - a k . 

The result of the reduction in the system (8.88) amounts to a function 
<Jk(uk,Pk,k), which depends parametrically on the hydrodynamic variables 
u k and p k , and also on the wave vector k. Due to the linearity of the problem 
under consideration, this function depends linearly on u k and p k , and we can 
start with the form given by (8.21): 

o-k(u k ,p k , k) = ikAu k - k 2 Bpk , (8.89) 


where A and B are undetermined functions of k. Now, however, we do not 
refer to a power series representation of these functions as in (8.22). 

Given the form of the function cr k (u k ,p k ,k) (8.89), we can compute its 
time derivative in two different ways. On one hand, substituting (8.89) into 
the right hand side of the third equation in the set (8.88), we derive: 

+ A] u k + k 2 Bp k . (8.90) 



On the other hand, computing the time derivative and using the first two 
equations (8.88), we obtain: 


^macro 


_da k d(j k 

&k — o T o &tPk 
ou k op k 


= ikA (—ikp k — ik(j k ) — k 2 B 



= ik 


{^k 2 B + k 2 A^j 


u k + k 2 (A - k 2 B) p k 


(8.91) 


Equating the expressions in the right hand sides of (8.90) and (8.91), and 
requiring that the resulting equality holds for any values of the variables u k 
and p k , we derive the following two algebraic equations: 

F(A, B,k) = -A-^-k 2 (^B + A 2 ^J= 0 , (8.92) 

G(H, B, k) = -B + A (1 - k 2 B) = 0 . 

These are exactly the equations (8.32), which were obtained after summation 
of the Chapman-Enskog expansion. Now, however, we have reached the same 
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result without using the expansion. Thus, (8.92) (or, equivalently, (8.32)) can 
be used as a starting point for the construction of the function (8.89). 

It is important to comment on the somewhat formal manipulations which 
have led to (8.92). First of all, by the very sense of the reduced description 
problem, we are looking for a set of functions dk which depend on time only 
through the time dependence of the hydrodynamic variables Uk and pk- That 
is, we are looking for a set (8.89), which is parameterized with the values 
of the hydrodynamic variables. Further, the two time derivatives, (8.90) and 
(8.91), are relevant to the “microscopic “ and the “macroscopic” evolution 
within the set (8.89), respectively. Indeed, the expression in the right hand 
side of (8.90) is just the value of the vector field of the original Grad equations 
at the points of the set (8.89). On the other hand, (8.91) expresses the time 
derivative in terms of the reduced (macroscopic) dynamics, which, in turn, is 
self-consistently defined by the form (8.89). Equations (8.92) provide, there¬ 
fore, the dynamic invariance condition of the reduced description for the set 
(8.89): the function crk(uk(t),Pk(t),k) is a solution to both the full Grad 
system (8.88) and to the reduced system which consists of the first two (hy¬ 
drodynamic) equations. For this reason, equations (8.92) and their analogs 
which will be obtained on similar reasoning, will be called the invariance 
equations. 


8.4.3 The Newton Method 


Let us concentrate on the problem of solving the invariance equations (8.92). 
Clearly, if we are going to expand the functions A and B into power series 
(8.22), we shall return to the Chapman-Enskog procedure. Now, however, 
we see that the Chapman-Enskog expansion is just a method to solve the 
invariance equations (8.92), and maybe not even the optimal one. 

Another possibility is to use iterative methods. Indeed, we shall apply 
Newton’s method. The algorithm is as follows: Let Ao and Bo are some initial 
approximations chosen for the procedure. The correction, Ai = A 0 + SAi and 
B\ = Bo + SBi, due to the Newton iteration is obtained upon a linearization 
(8.92) around the approximation Aq and Bo- Computing the derivatives, we 
can represent the equation of the Newton iteration in matrix form: 


( dF(A,B,k) | dF(AjBjk) 

OA \A=A 0 ,B=B 0 dB 
dG(A,B,k) | dG(A,B,k) 

OA \A=Ao,B=B 0 dB 


\A=A 0: B=B 0 

\a=a 0 ,b=b 0 _ 



(F(Ao,B 0 ,k) \ _ n 
\G(Ao,B 0 ,k)J 


where 


dF(A, B, k) 
dA 

dF(A, B, k) 


\a=Ao,b=b 0 ~ (-*- + 2 k 2 A 0 ) , 

= --k 2 

o 3 fc ’ 


(8.93) 


(8.94) 


dB 


A — Aq ,B — B( 
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dG(A,B,k) 

8A 

dG(A,B,k) 

dB 


\a=A 0 ,B=B 0 ~ 1 k2B ° ’ 
\a=a 0 ,b=Bq = ~ (l + k 2 A o) • 


Solving the system of linear algebraic equations, we come to the first correc¬ 
tion SAi and 8B\. Further corrections are found iteratively: 


A n-\- 1 — A n A 8A n _t r i , (8.95) 

B n -\-i — B n + SB n -|_i , 


where n > 0, and 


Ml+ 2 k 2 A n ) -\k 2 \ (8A n+ i 
V 1 -k 2 B n -(1 + k 2 A n )J \5B n+1 


( F(A n ,B n ,k)\ 
\G(A n , B n , k) J 


(8.96) 


Within the algorithm just presented, the problem is how to choose the 
initial approximation Aq and Bq. The recursion (8.95) and (8.96) is applicable 
formally to any initial approximation. However, the convergence (if at all) 
might be sensitive to the choice. 

For the first experiment let us take the Navier-Stokes approximation of 
the functions A and B: 



The outcome of the first two Newton iterations (the attenuation rates as 
they follow from the first and second Newton iteration) are presented in 
Fig. 8.5. It is clearly seen that the Newton iterations converge rapidly to the 
exact solution for moderate fc, but the asymptotic behavior in the short-wave 
domain does not improve. 

Another possibility is to take the result of the regularization procedure as 
presented above. Let the regularized Burnett approximation (8.80) be taken 
for the initial approximation, that is: 


A 0 = Af 


4 

3 + 5 fc 2 


B 0 = B\ l 


4 

3 + 5fc 2 ‘ 


(8.97) 


Substituting (8.97) into (8.95) and (8.96) for n = 0 we obtain, after some 
algebra, the following first correction: 

4(27 + 63 k 2 + 153 k 2 k 2 + 125 k 2 k 2 k 2 ) 

1 3(3 + 5/c 2 )(9 + 9k 2 + 67k 2 k 2 + 7bk 2 k 2 k 2 ) ’ 

4(9 + 33k 2 + llbk 2 k 2 + 75k 2 k 2 k 2 ) 

1 (3 + 5& 2 )(9 + 9k 2 + 67k 2 k 2 + 75k 2 k 2 k 2 ) 


Functions (8.98) are not yet the exact solution to (8.92) (that is, the func¬ 
tions F(Ai,Bi, k ) and G(Ai,Bi, k ) are not equal to zero for all k). However, 
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Fig. 8.5. Attenuation rates for the Newton method with the Navier-Stokes approx¬ 
imation as the initial condition. Dots : The Navier-Stokes approximation. Solid : The 
first and the second iterations of the invariance equation. Circles : The exact solution 
to the invariance equation. Diamonds : The super-Burnett approximation 


substituting A\ and B\ instead of A and B into the dispersion relation (8.23), 
we derive in the short-wave limit: 

lim u± = — \ =b i\k\V3 . (8.99) 

That is, already the first Newton iteration, as applied to the regularized Bur¬ 
nett approximation, leads to the exact expression in the short-wave domain. 
Since the first Newton iteration appears to be asymptotically exact, the next 
iterations improve the solution only for the intermediate values of fc, whereas 
the asymptotic behaviour remains exact in all iterations. The attenuation 
rates for the first and second Newton iterations with the initial approxima¬ 
tion (8.97) are plotted in Fig. 8.6. The agreement with the exact solution is 
excellent. 

One more test is to take the result of the super-Burnett approximation 
(8.85) as an initial condition in the Newton procedure (8.96). As we know, the 
regularization of the super-Burnett approximation provides a poorer approx¬ 
imation in comparison to (8.97), particularly in the short-wave domain. Nev¬ 
ertheless, the Newton iterations do converge though less rapidly (see Fig. 8.7). 

The examples considered so far demonstrate that the Newton method, 
as applied to the invariance equations (8.92) is a more powerful tool in 
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Fig. 8.6. Attenuation rates with the regularized Burnett approximation as the 
initial condition for the Newton method. Dots : The regularized Burnett approx¬ 
imation, or the first Newton iteration with the Euler initial condition (see text). 
Solid : The first and the second Newton iterations with the regularized Burnett ap¬ 
proximation as the initial condition. Circles : The exact solution to the invariance 
equation 


comparison to the Chapman-Enskog procedure. It is also important that 
the initial approximation should be “properly chosen”, and that it should 
reproduce, at least qualitatively, the features of the solution not only in the 
long-wave limit, but over the whole range of wavenumbers. 

The best from the initial approximations considered so far is the regu¬ 
larized Burnett approximation (8.97). We have already commented on the 
relation of this approximation to the invariance equations, as well as on its 
relation to the Chapman-Enskog procedure. The further important observa¬ 
tion is as follows: 

Let us choose the Euler approximation for the functions A and B , that 
is: 

A 0 =B 0 = 0 (8.100) 

The equation of the first Newton iteration (8.96) is very simple: 


-1 

1 




= 0 , 


and 


Mi 

5B 1 


( 8 . 101 ) 
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k 



Fig. 8.7. Attenuation rates with the regularized super-Burnett approximation as 
the initial condition for the Newton method. Dots : The regularized super-Burnett 
approximation. Solid : The first and the second Newton iterations. Circles : The 
exact solution to the invariance equation 


Ai=B 1 


4 

3 + 5 k 2 ' 


( 8 . 102 ) 


Thus, the regularized Burnett approximation is at the same time the first 
Newton correction as applied to the Euler initial approximation. This prop¬ 
erty distinguishes the regularization of the Burnett approximation from other 
regularizations. Now the functions (8.98) can be regarded as the second New¬ 
ton correction as applied to the Euler initial approximation (8.100). 

Finally, let us examine what Newton’s method does in the case of singular¬ 
ities. As we have demonstrated in the previous section, the singularity of the 
diffusion-like mode occurs when this mode couples to a non-hydrodynamic 
mode of the 10 moment Grad system if the spatial dimension is greater that 
one. 

Without proving it here, the invariance equation method as applied to 
the 10 moment Grad system (8.38) leads to the system of equations (8.65). 
We have already demonstrated what the outcome of the Newton method is 
when it is applied to the first two equations of this system (responsible for 
the acoustic mode and containing no singularities). The Newton method, as 
applied to (8.67), reads: 
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k 

0 0.1 0.2 0.3 0.4 0.5 



Fig. 8.8. The diffusion mode with the Euler initial approximation for the invariance 
equation. Upper solid : The the first iteration. Dots : The second iteration. Circles : 
The third iteration. Lower solid : The exact solution. Dash : The critical mode 

Y n+1 = Y n + 5Y n+1 , (8.103) 

(1 + 2 Y n )SY n+1 + {Y n (l + Y n ) + k 2 } = 0 , 

where n > 0, and Yq is a chosen initial approximation. Taking the Euler 
approximation (Yq = 0), we derive: 

Yi = -k 2 , (8.104) 

fc 2 (l + fc 2 ) 

F2 1 - 2fc 2 ' 

The second approximation, Y 2 , is singular at k -2 = yi/2, and it can be 
demonstrated that all further corrections also have the first singularity at 
points fc n , and the sequence • • •, k n tends to the actual branching point of 
the invariance equation (8.67) k c = 1/2. The analysis of further corrections 
demonstrates that the convergence is very rapid (see Fig. 8.8). 

The expressions (8.104) demonstrate that unlike polynomial approxima¬ 
tions, Newton’s method is capable of detecting the actual singularities of the 
hydrodynamic spectrum. Formally, the function Y 2 becomes positive as k 
becomes larger than & 2 , and thus the attenuation rate, ujd = Y 2 becomes pos¬ 
itive after this point. However, unlike the super-Burnett approximation for 
the acoustic mode, this transition occurs now at a singular point. Indeed, the 
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attenuation rate Y 2 tends to “minus infinity”, as k tends to k 2 from the left. 
Thus, as described with the Newton procedure, the non-physical domain is 
separated from the physical one with an “infinitely viscid” threshold. The oc¬ 
currence of the poles in the Newton iterations is, of course, quite clear. Indeed, 
the Newton method involves the derivative of the function R(Y) = Y(Y + 1) 
which appears on the left hand side of (8.67). The derivative dR(Y)/dY be¬ 
comes zero at the singularity point Y c = —1/2. The results of this section 
bring us to the following conclusion: 

(i) Exact summation of the Chapman-Enskog procedure results in the 
same system of equations as the principle of dynamic invariance. This was 
demonstrated above for a specific situation but it holds for any (linearized) 
Grad system. The resulting equations are always nonlinear (even for the 
simplest linearized kinetic systems, such as Grad equations). 

(ii) Now we are able to alter the viewpoint : the invariance equations can 
be considered as basic in the theory, while the Chapman-Enskog method is 
a way to solve it via an expansion in powers of k. The method of power 
series expansion is neither the only method to solve equations, nor the opti¬ 
mal. Alternative iteration methods might be better suited to the problem of 
constructing the reduced description. 

(iii) An opportunity to derive the invariance equation in closed form, 
and next to solve it this or that way is, of course, rather exotic. The situa¬ 
tion becomes complicated already for the nonlinear Grad equations, and we 
should not expect anything simple in the case of the Boltzmann equation. 
Therefore, if we are willing to proceed along these lines in other problems, 
attention should be drawn towards approximate procedures. With this, the 
question arises: what amount of information is required to execute the pro¬ 
cedures? Indeed, the Navier-Stokes approximation can be obtained without 
any knowledge of the whole nonlinear system of invariance equations. It is 
important that the Newton method, as applied to our problem, does not 
require any global information as well. This was demonstrated above by a re¬ 
lation between the first iteration as applied to the Euler approximation and 
the regularization of the Burnett approximation. 

8.4.4 Invariance Equation for the 1D13M Grad System 

Let us consider as the next example the problem of the reduced description 
for the one-dimensional thirteen moment Grad system. Using the dimension¬ 
less variables as above, we write the one-dimensional version of the Grad 
equations (8.2) and (8.3) in the ^-representation: 

(dtPk — iku k i 
d t u k = —ikpk ~ ikT k - ika k , 

2 2 

d t T k = —~iku k - -ikq k , 


(8.105) 
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dtcrk 


dtQk 


-~iku k 

ikT k 


ikqk <Jk 5 

15 

ika k - -qk • 


The Grad system (8.105) provides the simplest coupling of the hydrodynamic 
variables p/-, Uk , and Tk to the non-hydrodynamic variables, a k and qk , the 
latter corresponding to the heat flux. As above, our goal is to reduce the 
description of the Grad system (8.105) to the three hydrodynamic equations 
with respect to the variables pk , u k: and Tk. That is, we have to express the 
functions and qk in terms of pk , Uk , and T k : 


&k — &k (P/c i 'U'k 5 Tk , &) , 
Qk = Qk(pk,u k ,T k ,k) . 


Application of the Chapman-Enskog method in these cases, results in the 
following algebraic scheme (we omit the Knudsen number e): 


(n) j m ) (n—l—m) 8 (n—1) 1 

4 =- 4 + Y5 lkqk | 

f m=0 J 

«£"’ = - {"f a}”",+ *„<"-«} , 

lm=0 J 

where the Chapman-Enskog operators act as follows: 


dt Pk 
d[ m) u k 
d[ m) T k 


—ikuk , m — 0 

0, m > 1 ’ 

ik(p k + T/-), TYi 0 
—ika^ 1 m > 1 

— \ikuk , m = 0 
m > 1 


(8.106) 


(8.107) 


The initial condition for the recurrence procedure (8.106) reads: = 

— T^ikuk, and = — ^ikT k , which leads to the Navier-Stokes-Fourier hy¬ 
drodynamic equations. 

Computing the coefficients a^ and q£\ obtain the Burnett approxima¬ 
tion: 


dik = ~iku k + ^k 2 p k ~ » (8.108) 

15 7 

Qik — ~^ikTk T ~^k u k • 


The Burnett approximation (8.108) coincides with that obtained from the 
Boltzmann equation, and it is precisely the case where the instability was 
first demonstrated in the paper [72]. 
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The structure of the terms aj' 1 and q[ n> (an analog of (8.20) and (8.42)) 
is as follows: 

of n) = a n (-k 2 ) n iku k , (8.109) 

4 2 " +1> = K{~k 2 ) n+l p n + c n (-k 2 ) n+1 T k , 

q k n) = Pn(-k 2 ) n ikp k + 'j n (-k 2 ) n ikiT k , 

tffc 2 " +1) = a n (-k 2 ) n+1 u k . 

The derivation of the invariance equation for the system (8.105) goes 
along the same lines as in the previous section. We seek the functions of the 
reduced description in the form: 


a k = ikAuk — k 2 Bp k — k 2 CT k , (8.110) 

q k = ikXp k + ikYT k - k 2 Zu k , 


where the functions A ,..., Z will be determinated in the process. 

The invariance condition results in a closed system of equations for the 
functions A , T>, C, X , Y, and Z. As above, computing the microscopic time 
derivative of the functions (8.110), due to the two last equations of the Grad 
system (8.105) we derive: 

k 2 Z + AJu k (8.111) 

+k 2 (Ax + s) Pk + k 2 (Ay + cj r k , 

df CIO q k =k 2 ^A + 

-‘(f-‘ 2c “§ Y ) T “- 


|zj u k + ik (k 2 B - ) p k 


^micro 


n = ~ ik 1 3 “ 15 


On the other hand, computing the macroscopic time derivative due to the 
first three equations of the system (8.105), we obtain: 


da k 


da kn , da k 


= -AdtUk + -±d t p + T^dtTk 


du k 


Opl; OTf; 


= ik ( k 2 A 2 + k 2 B + k 2 C - | k 2 k 2 CZ) u k 
+ ( k 2 A — k 2 k 2 AB - \k 2 k 2 CX ) p k 


+ 


(k?A - k 2 k 2 AC - ^k 2 k 2 CY^j T k ; 


dr ci °Qk = d t u k + ^d tP u k + ^d t T k 


dq k 


dq k 


du k 


dp k 


dT k 


( 8 . 112 ) 


226 8 Hydrodynamics From Grad’s Equations: Exact Solutions 


= ( —k 2 k 2 ZA + k 2 X + \k 2 Y - \k 2 k 2 YZ 

O O 


Uk 


+ik 

+ik 


(k 2 Z -k 2 k 2 ZB + ^k 2 YX 
(k 2 Z -k 2 k 2 ZC +‘^k 2 Y 2 \ 


j Pk 
T k . 


Equating the corresponding expressions in the formulas (8.111) and (8.112), 
we derive the following system of coupled equations: 

F\ = — - + —k 2 Z -A-k 2 A 2 - k 2 B - -k 2 C + -k 2 k 2 CZ = 0 , 

3 15 3 3 

F 2 = —X + B-A + k 2 AB + -k 2 CX = 0 , 

15 3 

F 3 = ^-Y + C-A + k 2 AC + \k 2 CY = 0 , 

15 3 

F 4 = A + -Z + k 2 ZA -X--Y + -k 2 YZ = 0 , 

o o o 

F 5 = k 2 B --X- k 2 Z + k 2 k 2 ZB - -k 2 YX = 0 , 

O u 

F 6 = -- + k 2 C --Y- k 2 Z + k 2 k 2 ZC - -k 2 Y 2 = 0 . (8.113) 

z o o 

As above, the invariance equations (8.113) can also be obtained upon sum¬ 
mation of the Chapman-Enskog expansion, after the Chapman-Enskog pro¬ 
cedure is casted into a recurrence relations for the coefficients a n ,...,a n 
(8.109). This route is less straightforward than the one just presented, and 
we omit the proof. 

The Newton method, as applied to the system (8.113), results in the 
following algorithm: 

Denote as A the six-component vector function A = (A, 5, C, X, T, Z). 
Let Aq is the initial approximation, then: 


A- n -\-\ — A n T 5A n -|_i , 


(8.114) 


where n > 0, and the vector function 5A n + 1 is a solution to the linear system 
of equations: 

N n SA n+1 + F n = 0 . (8.115) 

Here F n is the vector function with the components F^(A n ), and N n is a 
6x6 matrix: 


( — (1 + 2k 2 A n ) 
k 2 B n - 1 
k 2 C n - 1 


1 + k 2 Z n 
0 
0 


-k 2 
1 + k 2 
0 
0 

k 2 (l + k 2 Z n ) 

0 


—2/3& 2 (l — k 2 Z n ) 
2/3 k 2 X n 

1 + 2/3 k 2 Y n + k 2 A n 
0 
0 

k 2 (l + k 2 Z n ) 


(8.116) 
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0 

2/3(4/5 + k 2 C n ) 

0 

-1 

-2/3(1 + k 2 Y n ) 
0 


0 2/3fc 2 (4/5 + k 2 C n ) \ 

0 0 

2/3(4/5 + k 2 C n ) 0 

—2/3(1 - k 2 Z n ) 2/3 + k 2 A n + 2/3 k 2 Y n 

-2/3k 2 X n -k 2 (l-k 2 B n ) 

-2/3(1+2 k 2 Y n ) —fc 2 (l — k 2 C n ) 


The Euler approximation gives: Aq = ... = Zq = 0, while F± = —4/3, 
F 6 = —5/2, and F 2 = ... = F 5 = 0. The first Newton iteration (8.115) 
as applied to this initial approximation, leads again to a simple algebraic 
problem, and we have finally obtained: 


Ai 

B 1 

Ci 

Vi 


Vi 


Zi 


on_'_ 

867fc 4 + 2105A: 2 + 300 ’ 

o 459A: 2 fc 2 + 810A: 2 + 100 

20 3468 ¥¥F 2 + 12755fc 2 fc 2 + 11725/c 2 + 1500 ’ 

51fc 2 A: 2 - 485fc 2 - 100 

10 3468fc 2 Pfc 2 + 12755fc 2 fc 2 + 11725& 2 + 1500 ’ 

31hk 2 (2lk 2 - 5) 

2(3468 Wk^k 2 + 12755fc 2 fc 2 + 11725fc 2 + 1500) ’ 

225(394 k 2 k 2 + 685A: 2 + 100) 
4(3468fc 2 fc 2 A: 2 + 12755A: 2 fc 2 + 11725fc 2 + 1500) ’ 
153fc 2 + 35 

15 867fc 4 + 2105A: 2 + 300 ‘ 


(8.117) 


Substituting (8.109) into the first three equations of the Grad system 
(8.105), and proceeding with the dispersion relation as above, we derive the 
latter in terms of the functions A,... ,Z: 


Y + Ajuj 2 (8. 

+ k 2 (- - -k 2 Z - -k 2 C - k 2 B + -k 2 AY + -k 2 k 2 CZ) lo 

\ o o o o o J 

+ -k 2 (k 2 X - k 2 Y + k 2 k 2 BY - k 2 k 2 XC) = 0 . 

o 

When the functions (8.117) are substituted instead of A ,..., Z 

into (8.118), the dispersion relation of the first Newton iteration, as applied 
to the invariance equations (8.113) with the Euler initial approximation, is 
obtained. This result coincides with the regularization of the Burnett approx¬ 
imation, which was considered in [43]. There it was demonstrate that the 
equilibrium is stable within this approximation for arbitrary wave lengths. 
The dispersion relation for the Burnett approximation, in turn, is due to the 
approximation 
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A = -4/3 , B = -4/3 , C = 2/3 , X = 0, Y = -15/4 , Z = -7/4 , 


as it follows from a comparison of (8.108) and (8.110). The dispersion relation 
for the Burnett approximation coincides with the one obtained in [72] from 
the Boltzmann equation. 

8.4.5 Invariance Equation for the 3D13M Grad System 

The final example to be considered is the 13 moment Grad system in three 
spatial dimensions, (8.2) and (8.3). Let us rewrite here the original system in 
terms of Fourier variables: 

d t pk = -ike k ■ u k , (8.119) 

dtu k — ike k p k ike k T k ikc k (J , 

2 

d t T k = -~ik(e k ■ u k + e k ■ q k ) , 

d t cr k = -imuk ~ \imq k - cr k , 

5 2 

9tq k = -~ike k T k - ike k ■ a k - -q k . 

Here we have represented the wave vector k as k = and is the unit 
vector. 

The structure of the even and odd Chapman-Enskog coefficients, 
and q^\ turns out to be as follows: 

= {—k 2 ) n ik {a n (e k u k - 2 g k (e k ■ u k )) + b n g k (e k ■ u k )} , 
cr k n+1) = (~k 2 ) n+1 g k {c n T k + d n p k } , 
q k n) = (~k 2 ) n ike k {'y n T k + 5 n p k } , 
q k n+1) = (~k 2 ) n+1 {a n e k (e k ■ u k ) + f3 n {u k - e k {e k ■ u k )} , (8.120) 

where g k = l/2e^eL, and the real-valued coefficients a n ,... ,/3 n are due to 
the Chapman-Enskog procedure (8.7) and (8.8). 

The expressions just presented suggest that the dynamic invariant form 
of the stress tensor and of the heat flux reads: 

a k = ikA(e k Uk ~ 2 g k {e k • u k )) + 2 ikBg k (e k ■ u k ) (8.121) 

-2 k 2 Cg k T k - 2k 2 Dg k p k , 
q k = ikZe k T k +ikUe k p k 

—k 2 X(u k - e k (e k ■ u k )) - k 2 Ye k {e k ■ u k ) , 

where the functions A ,..., Y depend on k. The dynamic invariance condition 
results in the following two closed systems for these functions: 
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hj + D - B + \k 2 CU +\k 2 BD = 0, (8.122) 

o o o 

%Z + C - B + \k 2 CZ + f k 2 BC = 0 , 

5 3 3 

-1 + -k 2 Y -B- -k 2 C - k 2 D - -k 2 B 2 + -k 2 k 2 CY = 0 , 

5 3 3 3 

-k 2 D --U- k 2 Y - -k 2 ZU + -k 2 k 2 YD = 0 , 

3 3 3 3 

-- + -k 2 C -%Z- k 2 Y - -k 2 Z 2 + -k 2 k 2 YC = 0 , 

2 3 3 3 3 

-B + -Y-U--Z+ -k 2 ZY + -k 2 YB = 0 , 

3 3 3 3 3 

and 

-l-A+-k 2 X-k 2 A 2 = 0, (8.123) 

0 

A + -X + k 2 AX = 0 

o 

The method of summation of the Chapman-Enskog expansion can also be 
developed, starting with the structure of the Chapman-Enskog coefficients 
(8.120), in the same manner as in Sect. 8.3. Simple but rather extensive 
computations in this case lead, of course, to the invariance equations (8.122) 
and (8.123). 

The Newton method, as applied to the systems (8.122) and (8.123) with 
the initial Euler approximation, leads in the first iteration to the regulariza¬ 
tion of the Burnett approximation reported earlier in [43]. 

Introducing the functions A = k 2 A and X = k 2 X in (8.123) we obtain: 


R(A) = 


5A(3A 2 T 5A T 2) 
4(6,4 + 5) 


= -k 2 


(8.124) 


while 


X = - 


3 A 

2 + 3,4 ‘ 


The derivative, dR(A)/dA , becomes equal to zero for A c « —0.364, which 
gives the critical wave vector k c = \J—R(A C ) « 0.305. The Newton method, 
as applied to (8.124) with the initial Euler condition A = 0, gives the follow¬ 
ing: the results of the first and of the second iterations are regular functions, 
while the third and the further iterations bring a singularity which converges 
to the point k c (see Fig. 8.9). These singularities (the real poles) of the New¬ 
ton corrections are of the same nature as discussed above. 
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k 


0 0.1 0.2 0.3 0.4 0.5 



Fig. 8.9. Solutions to (8.123). Circles : Numerical solutions. Dots : The first Newton 
iteration. Solid : The 4th Newton iteration 


8.4.6 Gradient Expansions in Kinetic Theory of Phonons 

Exact Chapman—Enskog Solution and Onset of Second Sound 

In this section, we close our discussion of linearized Grad systems with an 
application to simple models for phonon transport in rigid insulators. It is 
demonstrated that the extended diffusion mode transforms into a second 
sound mode due to its coupling to a non-hydrodynamic mode at some critical 
value of the wave vector. This criticality shows up as a branching point of 
the extension of the diffusion mode within the Chapman-Enskog method. 
Although the analysis is essentially similar to the examples considered above, 
it is presented in some details for the sake of completeness. 

Experiments on heat pulse propagation through crystalline media [206, 
207] confirmed the existence of a temperature window (the Guyer-Krumhansl 
window [208-210]) with respect to which the features of heat propagation are 
qualitatively different: At temperatures exceeding the high-temperature edge 
of the window, the heat propagates in a diffusion-like way. Below the low- 
temperature edge of the window, the propagation goes in a ballistic way, with 
the constant speed of sound. Within the window, the propagation becomes 
wave-like. This latter regime is called second sound (see [211] for a review). 

This problem has drawn some renewed attention in the last years. Mod¬ 
els relevant for a unified description of diffusion, second sound, and ballistic 
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regimes of heat propagation are intensively discussed (see [212,251] and ref¬ 
erences therein). To be specific, recall the simplest and typical model of the 
phonon transport [212]. Let e(x,t) and p(x,t) be small deviations of the 
energy density and energy flux of the phonon field from their equilibrium 
values, respectively. Then 



(8.125) 

(8.126) 


3 t r 


Here c is the Debye velocity of phonons, and tr is the characteristic time 
of resistive processes. Equations (8.125) can be derived from the Boltzmann- 
Peierls kinetic equation, within the relaxation time approximation, by a 
method similar to Grad’s method [212]. Equations (8.125), (8.126) provide 
the simplest model of coupling between the hydrodynamic variable e and 
the non-hydro dynamic variable p, allowing for a qualitative description of 
both the diffusion and the second sound. Following the standard argumenta¬ 
tion [212], we observe the two limiting cases: 

1. As tr —> 0, equation (8.126) yields the Fourier relation p = — |r#Ve 
which closes (8.125) to give the diffusion equation: 



(8.127) 


2. As tr —> oo, (8.126) yields d t p = — |Ve, and (8.125) closes to give the 
wave equation: 



(8.128) 


Equation (8.127) describes the usual diffusive regime of heat propagation, 
while (8.128) is relevant to the (undamped) second sound regime with the 
velocity u 2 = cj\[Z\ both are closed with respect to the variable e. 

However, even within the simplest model (8.125), (8.126), the problem of 
closure remains unsolved in a systematic way when tr is finite. The natural 
way of doing so is provided by the Chapman-Enskog method. In the situation 
under consideration, the Chapman-Enskog method yields an extension of 
the diffusive transport to finite values of the parameter 7 #, and leads to an 
expansion of the non-hydrodynamic variable p in terms of the hydrodynamic 
variable e. With this, if we are able to make this extension of the diffusive 
mode exactly, we could learn more about the transition between the diffusion 
and second sound (within the framework of the model). 

The Chapman-Enskog method, as applied to (8.125), (8.126), results in 
the following series representation: 


00 


P = Y J P {n) 


n=0 


(8.129) 
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where the coefficients p^ are due to the Chapman-Enskog recurrence pro¬ 
cedure, 

n —1 

p< n > = -TR El a t (m) p (n_1 " m) , (8.130) 

m =0 

while the Chapman-Enskog operators d^ act on e as follows: 

<9 t (m) e = —c 2 V-p (m) . (8.131) 

Finally, the zero order term reads: = — |r#Ve, and leads to the Fourier 

approximation of the energy flux. 

To sum up the series (8.129) in closed form, we shall specify the non¬ 
linearity appearing in equations (8.130) and (8.131). The coefficients p^ in 
equations (8.129) and (8.130) have the following explicit structure for arbi¬ 
trary order n > 0: 

p (n) = a n Z\ n Ve , (8.132) 

where the real-valued and yet unknown coefficients a n are due to the re¬ 
currence procedure (8.130), and (8.131). Indeed, the form (8.132) is true for 
n = 0 (ao = — \tr ). Let us assume that (8.132) is proven up to order n — 1. 
Then, computing the nth order coefficient p ^, we derive: 


n— 1 


P (n) = ~ T R E 

m =0 
n— 1 

= -t r E (—c 2 a m V • VZ\ m e) 

m= 0 

— RC \ ^ ^ Cln—1—mClm / Ve . 

I m= 0 J 


(8.133) 


The last expression has the same form as (8.132). Thus, the Chapman- 
Enskog procedure for the model (8.125), (8.126) is equivalent to the following 
nonlinear recurrence relation in terms of the coefficients a n : 


n —1 

CL n = T~rC 'y ^ CL n _i_ rn CL rn , (8.134) 

m =0 


subject to the initial condition ao = — \tr. Further, it is convenient to make 
the Fourier transform. Using p = p k exp {ik • x} and e = exp {ik • a?}, where 
k is the real-valued wave vector, we derive in (8.132): p^ = a n ik(—k 2 ) n eki 
and 


where 


Pk = ikA(k 2 )e k , 


(8.135) 
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A{k 2 ) = ^a n {-k 2 ) n . (8.136) 

n=0 

Thus, the the Chapman-Enskog solution (8.129) amounts to finding the func¬ 
tion A(k 2 ) represented by the power series (8.136). If the function A is known, 
the exact Chapman-Enskog closure of the system (8.125), (8.126) amounts 
to the following dispersion relation of plane waves ~ exp {(J k t + ik • x}: 

cj k = c 2 k 2 A(k 2 ) . (8.137) 

Here uo k is a complex-valued function of the real-valued vector k : Re(o;/ c ) is 
the attenuation rate, lm(wk) is the frequency. 

Multiplying both equations in (8.134) with (—/c 2 ) n , and performing a 
summation in n from 1 to infinity, we get: 

oo n 

A - a 0 = -r R c 2 k 2 ^ £ a n - m (—k 2 ) n ~ m a m (—k 2 ) m , 

n= 0 m= 0 


Now we notice that 


N n 

lim W W a n - m (-k 2 ) n ~ m a m (-k 2 ) m = A 2 , 

N —^-OO ' ^ Z ^ 
n =0 m =0 


Setting ao = — \tr, we derive a quadratic equation for the function A: 


r R c 2 k 2 A 2 + A + ^t r = 0 . 


(8.138) 


Further, a selection procedure is required to choose the relevant root of 

(8.138) . Firstly, recall that all the coefficients a n (8.132) are real-valued by the 
sense of the Chapman-Enskog method (8.130) and (8.131), hence the func¬ 
tion A (8.136) is real-valued. Therefore, only the real-valued root of (8.138) 
is relevant to the Chapman-Enskog solution. The first observation is that 

(8.138) has no real-valued solutions as soon as k becomes bigger than the 
critical value fc c , where 


k c 


Vs_ 

2t r c ' 


(8.139) 


Secondly, there are two real-valued solutions to (8.138) at k < k c . However, 
only one of them satisfies the Chapman-Enskog asymptotic lim/^o A{k 2 ) = 

i 

“3 TR - 

With these two remarks, we finally derive the following exact Chapman- 
Enskog dispersion relation (8.137): 


Uk 


-{2m)- 1 (i - yi - W)M)) 

none 


k < k ( 
k > k { 


(8.140) 
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This dispersion relation corresponds to the extended diffusion transport, 
and it conies back to the standard Fourier approximation in the limit of 
long waves k/k c <C 1. The Chapman-Enskog solution does not exist as soon 
as k/k c > 1. For k = k c , the extended diffusion branch crosses one of the 
non-hydrodynamic branches of (8.125), (8.126). For larger fc, the extended 
diffusion mode and the critical non-hydro dynamic mode produce a pair of 
complex conjugate solutions with the real part equal to — The imaginary 
part of this extension after k c attains the asymptotic value Fiu^k, as k —> oo, 
where = c/v^ is the (undamped) second sound velocity in the model 

(8.125), (8.126) (see equation (8.128)). Although the spectrum of the original 

(8.125) , (8.126) continues indeed after fc c , the Chapman-Enskog method does 
not recognize this extension as part of the hydrodynamic branch, while the 
second sound regime is born from the extended diffusion after coupling with 
the critical non-hydrodynamic mode. 

Finally, let us consider the opportunities provided by the Newton method 
as applied to the invariance equation. First, the invariance equation can be 
easily obtained in closed form here. Consider again the expression for the 
heat flux in terms of the energy density (8.135), p k = ikA(k 2 )e k , where 
now the function A is not thought as the Chapman-Enskog series (8.136). 
The invariance equation is a constraint on the function A, expressing the 
form-invariance of the heat flux (8.135) under both the dynamic equations 

(8.125) and (8.126). Computing the time derivative of function (8.135) due 
to equation (8.125), we obtain: 

dfi acro p k = ikA(k 2 )d t e k = c 2 k 2 A 2 ike k . (8.141) 


On the other hand, computing the time derivative of the same function due 
to equation (8.126), we have: 

d™ lcro p k = ~\ike k ~—Aike k . (8.142) 

4 tr 

Equating (8.141) and (8.142), we derive the desired invariance equation for 
the function A. This equation coincides with the exact Chapman-Enskog 
equation (8.138). 

As the second step, let us apply the Newton method to the invariance 
equation (8.138), taking the Euler approximation (A$ = 0) as the initial 
condition. Rewriting (8.138) in the form F(A,k 2 ) = 0, we come to the fol¬ 
lowing Newton iterations: 

(A n+1 - A n ) + F(A n ,k 2 ) = 0 . (8.143) 

A—A n 


d F(A,k 2 ) 
dA 


The first two iterations give: 


t r 1a i 


Tr'A* 



i-F 2 

3(1 - \v 2 ) ■ 


(8.144) 


(8.145) 
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The first Newton iteration (8.144) coincides with the first term of the 
Chapman-Enskog expansion. The second Newton iteration (8.145) is a ratio¬ 
nal function with the Taylor expansion coinciding with the Chapman-Enskog 
solution up to the super-Burnett term, and it has a pole at 2/2 = a/2. The fur¬ 
ther Newton iterations are also rational functions with the relevant poles at 
points y n , and the sequence of this points tends very rapidly to the location 
of the actual singularity y c = 1 ( 2/3 « 1.17, 2/4 ~ 1.01, etc.). 

Inclusion of Normal Processes 

Accounting for normal processes in the framework of the semi-hydrodynamical 
models [212] leads to the following generalization of (8.125), (8.126) (written 
in Fourier variables for the one-dimensional case): 


d t e k = -ikc 2 p k , 

d+Vb = —ikeb — ikNb - pk 


(8.146) 

(8.147) 



(8.148) 


where r = tntr/(tn + t#), tn is the characteristic time of normal processes, 
and 7V/c is the additional field variable. Following the principle of invariance 
as explained in the preceding section, we write the closure relation for the 
non-hydrodynamic variables pk and Nk as: 


(8.149) 


Pk — 'ik’AfcCki Nk — BfcCfc 


where Ak and Bk are two unknown functions of the wave vector k. Further, 
following the principle of invariance as explained in the previous section, 


each of the relations (8.149) should be invariant under the dynamics due to 


(8.146), and due to (8.147) and (8.148). This results in two equations for the 
functions Ak and B^\ 



(8.150) 


When the energy balance equation (8.146) is closed with the relation (8.149), 
this amounts to a dispersion relation for the extended diffusion mode, Uk = 


k 2 c 2 Ak , where Ak is the solution to the invariance equations (8.150), subject 


to the condition Ak —> 0 as k —> 0. Resolving equations (8.150) with respect 
to Ak, and introducing Ak = k 2 c 2 Ak , we arrive at the following: 


n = 5A k (l + TA k )(TRA k + l) 
[ k 5 + 9 rA k 



(8.151) 
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The invariance equation (8.151) is completely analogous to the (8.138). Writ¬ 
ten in the form (8.151), it allows for a direct investigation of the critical points. 
For this purpose, we find zeroes of the derivative, d<P(A k )/dA k = 0. When 
the roots of the latter equation, A k , are found, the critical values of the wave 
vector are given as —(1/3 )k^c 2 = d>(A c k ). The condition dd>(A k )/dAk = 0 
reads: 

18 t 2 t r aI + 3t(3t + 8 T R )A 2 k + 10(r + r R )A k + 5 = 0. (8.152) 

Let us consider the particularly interesting case, e = tn/tr <C 1 (the 
normal events are less frequent than resistive). Then the real-valued root of 
(8.152), Afc(e), corresponds to the coupling of the extended diffusion mode to 
the critical non-hydrodynamic mode. The corresponding modification of the 
critical wave vector k c (8.139) due to the normal processes amounts to shifts 
towards shorter waves, and we derive: 

[fc c (e)] 2 = k 2 c + ^ . (8.153) 

R 


Accounting for Anisotropy 

The above examples concerned the isotropic Debye model. Let us consider 
the simplest anisotropic model of a cubic media with a longitudinal (L) and 
two degenerated transverse (T) phonon modes, taking into account resistive 
processes only. Introduce the Fourier variables, e^, e k , p k , and p k , where 
e k = e k +2e k is the Fourier transform of the total energy of the three phonon 
modes (the only conserved quantity), while the rest of variables are specific 
quantities. The isotropic model (8.125), (8.126) generalizes to [212]: 


d t e k = -ic\k ■ p k - 2ic 2 T k • pi , (8.154) 

d t el = -ic 2 T k 'Pk +\ [4 (e k - 2 el) - c z T el] , (8.155) 

dtPfc = ~\ik{e k - 2el) - \pl , (8.156) 

6 r R 

dtPl = ~\ikel - \pl , (8.157) 

3 t r 


where A = + 2r^c\. The term containing the factor A -1 corresponds 

to the energy exchange between the L and T phonon modes. The invariance 
constraint for the closure relations, 

p k = ikA k e k , pi = ikB k e k , e k = X k e k , (8.158) 

result in the following invariance equations for the fc-dependent functions A k , 
B k , and X k : 
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k 2 c 2 L A 2 k + 2k 2 c R A k B k = —~^A k - 1 (1 - 2X k ) , (8.159) 

t r 3 

2k 2 c 2 T Bl + k 2 c L B k A k = ~-^B k - ]-X k , (8.160) 

r R 6 

Xk (j^dj^Ak H- 2k?CjiBj^ = c^k 2 Bk + — [c^ — X^ (2c^ + c t)] -(8-161) 

When the energy balance equation (8.154) is closed with the relations (8.158), 
we obtain the dispersion relation for the extended diffusion mode, ujk = 
Ak + 2 Bk, where the functions Ak = k 2 c\Ak , and = k 2 c R Bk, satisfy 
the conditions: A —> 0, and B —> 0, as k —> 0. The resulting dispersion 
relation is rather complicated in the general case of the four parameters of 
the problem, cl, ct , r R and r R . Therefore, introducing the function Y \ c = 
A^ + 2B/c, let us consider the following specific situations of closed equations 
for the Yk on the basis of the invariance equations (8.159): 

(i) cl = ct = c, r R «= r R = r# (complete degeneration of the parameters 
of the L and T subsystems): The system (8.159) results in two decoupled 
equations: 


Yk (■ t r Yk + l) + -k 2 c 2 r R = 0 , (8.162) 

+ l) 2 + lfc 2 c 2 r^ = 0 . (8.163) 

Equation (8.162) coincides with (8.138) for the isotropic case, and its solution 
defines the coupling of the extended diffusion to a non-hydro dynamic mode. 
Equation (8.163) does not have a solution with the required asymptotic be¬ 
havior Y k —> 0 as fc ->0, and is therefore irrelevant to the features of the 
diffusion mode in this completely degenerated case. It describes the two fur¬ 
ther propagating and damped non-hydro dynamic modes of the (8.154). The 
nature of these modes, as well of the mode which couples to the diffusion 
mode well be seen below. 

(ii) cl = ct = c, Tft j- r R (nondegenerate characteristic time of resistive 
processes in the L and T subsystems): 


Yk {JrY k + 1 ) + \k 2 c 2 T % 
+ \k 2 c 2 (r£ - t£) = 0 , 


X 


(trY k + 3) (jlYk + 1) + ^k 2 c 2 T%T' R 

(8.164) 


where r' R = 2 r R + r R . As r R — r R —> 0, (8.164) tends to the degener¬ 
ated case (8.162). At k = 0, r R ^ r R , there are four solutions to (8.164). 
The Yq = 0 is the hydrodynamic solution indicating the beginning of the 
diffusion mode. The two non-hydrodynamic solutions, Y o = — 1/r^, and 
Fo = -1/7-2, ^0 = -3 /r'R, are associated with the longitudinal and the 
transverse phonons, respectively. The difference in relaxational times makes 
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the latter transverse root nondegenerate, and the third non-hydro dynamic 
mode, Y o = —3 /r' R , appears instead. 

(iii) cl ct, = r R = tr (nondegenerate speed of the L and the T 
sound). 


Y 


k (trYi c + l) + -k 2 C 2 L TR 


(jrY k + l ) 2 + 3 k 2 c 2 T T 2 R 


2 , 2 . 4(4-cl) 

4 k TR 2c?+4 {trYu 


i)=o. 


(8.165) 


As cr — Cl —* 0, (8.165) tends to the degenerate case (8.162). However, this 
time the non-hydro dynamic mode associated with the transverse phonons 
degenerates at k = 0. 

Thus, we are able to identify the modes in (8.162) and (8.163). The non¬ 
hydrodynamic mode which couples to the extended diffusion mode is associ¬ 
ated with the longitudinal phonons, and is the case (8.162). The case (8.163) 
is due to the transverse phonons. In the nondegenerate cases, (8.164) and 
(8.165), both pairs of modes become propagating after a certain critical val¬ 
ues of fc, and the behavior of the extended diffusion mode is influenced by all 
three non-hydrodynamic modes just mentioned. It should be stressed, how¬ 
ever, that the second sound mode, which is the continuation of the diffusion 
mode [206,207], is due to (8.162). The results of the above analysis lead to 
the following conclusion: 

(i) The examples considered above indicate an interesting mechanism of a 
kinetic formation of the second sound regime from the extended diffusion with 
the participation of the non-hydro dynamic mode. The onset of the propagat¬ 
ing mode shows up as the critical point of the extension of the hydrodynamic 
solution into the domain of finite fc, which was found within the Chapman- 
Enskog and equivalent approaches. These results concern the situation at 
the high-temperature edge of the Guyer-Krumhansl window, and are com¬ 
plementary to the coupling between the transversal ballistic mode and the 
second sound at the low-temperature edge [213]. 

(ii) The crossover from the diffusion-like to the wave-like propagation 
was previously found in [214-216] in the framework of exact Chapman- 
Enskog solution to the Boltzmann equation for the Lorentz gas model 
[202], and for similar models of phonon scattering in anisotropic disor¬ 
dered media [217]. The characteristic common feature of the models stud¬ 
ied in [202,214-217] and the models [212] is the existence of a gap between 
the hydrodynamic (diffusive) and the non-hydro dynamic components of the 
spectrum. Therefore, one can expect that the destruction of the extended 
diffusion is solely due to the existence of this gap. In applications to the 
phonon kinetic theory this amounts to the introduction of the relaxation time 
approximation. In other words, we may expect that the mechanism of 
crossover from diffusion to second sound in the simple models [212] is iden¬ 
tical to what could be found from the phonon-Boltzmann kinetic equation 
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within the relaxation time approximation. However, it should be noted that 
the original (i.e., without the relaxation time approximation) phonon kinetic 
equations are gapless (see, for example, [211]). On the other hand, most of the 
works on heat propagation in solids do exploit the idea of the gap, since it is 
only possible to speak of diffusion if such a gap exists. To conclude this point, 
the following general hypothesis can be expressed: the existence of diffusion 
(and hence of the gap in the relaxational spectrum) leads to its destruction 
through the coupling with a non-hydrodynamic mode. 

8.4.7 Nonlinear Grad Equations 

In the preceding sections, the Chapman-Enskog and other methods were 
probed explicitly for the linearized Grad equations far beyond the usual 
Navier-Stokes approximation. This was possible, first of all because the prob¬ 
lem of the reduced description was shaped into a rather simple algebraic form. 
Indeed, the algebraic structure of the stress tensor <Jk(pk , Uk,Tk, k) and of the 
heat flux q k {Pk , T*., k ) was fairly simple. However, when we attempt to ex¬ 
tend the approach onto the nonlinear Grad equations, the algebraic structure 
of the problem is no longer simple. Indeed, when we proceed along the lines 
of the Chapman-Enskog method, for example, the number of types of terms, 
Vw, VVw, (Vu) 2 , VTVp, and so on, in the Chapman-Enskog coefficients 
a and q^ demonstrates a combinatorial growth with the order n. 

Still, progress is possible if we impose some rules for the selection of the 
relevant terms. As applied to the Chapman-Enskog expansion, these selec¬ 
tion rules prescribe that only contributions arising from terms with a definite 
structure in each order cr and q^ should be retained, and all other terms 
should be ignored. This approach can be linked again with the partial sum¬ 
mation rules for the perturbation series in many-body theories, where usually 
terms with a definite structure are summed instead of the whole series. Our 
viewpoint on the problem of the extension of the hydrodynamics in the non¬ 
linear case can be expressed as follows: The exact extension seems to be 
impossible, and, moreover, quite useless because of the lack of a physical 
transparency. Instead, certain sub-series of the Chapman-Enskog expansion, 
selected on clear physical grounds, may lead to less complicated equations, 
which, at the same time, provide an extension for a certain subclass of hy¬ 
drodynamic phenomena. This viewpoint is illustrated in this section by con¬ 
sidering a sub-series of the Chapman-Enskog expansion which provides the 
dominating contribution when the flow velocity becomes very large (and thus 
it is relevant to a high-speed subclass of hydrodynamic phenomena such as 
strong shock waves). 

The approach to the Chapman-Enskog series for the nonlinear Grad equa¬ 
tions just mentioned, and which was based on a diagrammatic representation 
of the Chapman-Enskog method, has been attempted earlier in [237]. In this 
section, however, we shall take the route of the dynamic invariance equations 
which leads to the same results more directly. 
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The Dynamic Viscosity Factor 

The starting point is the set of one-dimensional nonlinear Grad equations for 
the hydrodynamic variables p, u and T, coupled to the non-hydrodynamic 
variable cr, where a is the xx-component of the stress tensor: 


d t p = —d x (pu) ; 

d t u = -ud x u - p _1 d x p - p~ 1 d x a ; 

8 t T = —ud x T - (2/3 )Td x u - (2/3)p~ 1 ad x u ; 


(8.166) 

(8.167) 

(8.168) 

(8.169) 



Here fi(T) is the temperature-dependent viscosity coefficient. We shall adopt 
the form fi(T) = ckT 7 , which is characteristic to the point-center models of 
particles collisions, where 7 varies from 7 = 1 (the Maxwell molecules) to 
7 = 1/2 (hard spheres), and where a is a dimensional factor. 

Even in this model, the Chapman-Enskog expansion appears to be ex¬ 
ceedingly complicated in the full setting. Therefore, we address another, sim¬ 
pler problem: What is the leading correction to the Navier-Stokes approxi¬ 
mation when the characteristic value of the average velocity is comparable to 
the thermal velocity? 

Our goal is to compute the correction to the Navier-Stokes closure re¬ 
lation, <tns = —(4/3 )fid x u, for high values of the average velocity. Let us 
consider first the Burnett correction from (8.166): 



The correction of the desired type is given by the nonlinear term propor¬ 
tional to ( d x u ) 2 . Each further nth term of the Chapman-Enskog expansion 
contributes, among others, a nonlinear term proportional to (d x u ) nJrl . Such 
terms can be named high-speed terms since they dominate the rest of the con¬ 
tributions in each order of the Chapman-Enskog expansion when the charac¬ 
teristic average velocity is comparable to the heat velocity. Indeed, if U is a 
characteristic mean velocity, and u = Uu, where u is dimensionless, then the 
term ( d x u) n+1 receives the factor £/ n+1 which is the highest possible order 
of U among the terms available in the nth order of the Chapman-Enskog ex¬ 
pansion. Simple dimensional analysis leads to the conclusion that such terms 
are of the form iig n d x u , where g = p~ x fid x u is dimensionless. Therefore, the 
Chapman-Enskog expansion for the function a may be formally rewritten as: 



(8.171) 


The series in the brackets is the collection of the high-speed contributions 
of interest, coming from all orders of the Chapman-Enskog expansion, while 
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the dots outside the brackets stand for the terms of other nature. Thus, the 
high-speed correction to the Navier-Stokes closure relation in the framework 
of the Grad equations (8.166) takes the form: 


cr n i = —fiR(g)d x u 


(8.172) 


where R(g) is the function represented by a formal subsequence of Chapman- 
Enskog terms in the expansion (8.171). The function R can be viewed also as 
a dynamic modification of the viscosity fi due to the gradient of the average 
velocity. 

We shall now turn to the problem of an explicit derivation of the function 
R (8.172). Following the principle of dynamic invariance, we first compute 
the microscopic derivative of the function a n \ by substituting (8.172) into the 
right hand side of (8.169): 



(8.173) 


where dots denote the terms irrelevant to the closure relation (8.172) (such 
terms appear, because (8.172) is not the exact closure relation). 


Second, computing the macroscopic derivative of the closure relation 
(8.172) due to (8.166), (8.167), and (8.168), we obtain: 

d /? 

d”<r nl = -[d t n(T)]Rd x u - fi(T)— [d t g]d x u - fi(T)Rd x [d t u] . (8.174) 


In the latter expression, the time derivatives of the hydrodynamic variables 
should be replaced with the right hand sides of (8.166), (8.167), and (8.168), 
where, in turn, the function a should be replaced by the function a n \ (8.172). 
After some computation, we derive the following: 



(8.175) 


Again, the dots stand for the terms irrelevant to the present analysis. 

Equating the relevant terms in (8.173) and (8.175), we obtain the invari¬ 
ance equation for the function R: 


H 7? T 3 

(i - i)g 2 (i - gR) + i9 2 R 2 + ^ + 5 ( 2 - 7 ) R- 2 = 0 . (8.176) 


For Maxwell molecules (7 = 1), (8.176) simplifies considerably, and be¬ 
comes algebraic: 



(8.177) 
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Fig. 8.10. Viscosity factor R(g) for Maxwell molecules. Solid : exact solution. Dash : 
the Burnett approximation. Dots : the Navier-Stokes approximation 


The solution which recovers the Navier-Stokes closure relation in the limit 
of small g then reads: 


Rmm 


—3 —2ff + 3yi + (4/3)ff + V 
4 g 2 


(8.178) 


Function Rmm (8.178) is plotted in Fig. 8.10. Note that Rmm is positive for 
all values of its argument g, as is appropriate for the viscosity factor, while 
the Burnett approximation to the function Rmm violates positivity. 

For other models (7 7^ 1), the invariance equation (8.176) is a rather com¬ 
plicated nonlinear ODE with the initial condition i?(0) =4/3 (the Navier- 
Stokes condition). Several ways to derive analytic results are possible. One 
possibility is to expand the function R into powers of g , in the point g = 0. 
This will bring us back to the original sub-series of the Chapman-Enskog ex¬ 
pansion (see (8.171)). Instead, we take advantage of the opportunity offered 
by the parameter 7. Introduce another parameter [3=1— 7, and consider 
the expansion: 


R((3, 9) — Ro {9) + PRi ( 9 ) + p 2 R2 {9) + • • • • 

Substituting this expansion into the invariance equation (8.176), we derive 

Ro(g) = Rmm(9), 
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g 


Fig. 8.11. Viscosity factor R(g) for hard spheres. Solid : the first approximation. 
Dash : exact solution for the Maxwell molecules 


Ri(g) = -g {i -gR o) 


Ro+g(dRo/dg) 
2fl 2 i?o + 9 + (3/2) ’ 


(8.179) 


etc. That is, the solution for other models is constructed in a form of a series 
with the exact solution for the Maxwell molecules as the leading term. For 
hard spheres (/? = 1/2), the result to the first-order term reads: i?ns ~ + 

(l/2)i?i. The resulting approximate viscosity factor is shown in Fig. 8.11. The 
features of the approximation obtained are qualitatively the same as in the 
case of Maxwell molecules. 

It is interesting that precisely the same result for the nonlinear elonga- 
tional viscosity obtained in [17] was derived later by A. Santos [18] from the 
solution to the BGK kinetic equation in the regime of so-called homoener- 
getic extension flow, see also [19], where a misprint in [17] in formula (8.179) 
was detected. For further discussion, see [20] 


Attraction to the Invariant Set 

Above, we have derived a correction to the Navier-Stokes expression for the 
stress cr, in the one-dimensional case, for large values of the average velocity 
u. This correction has the form a = — fiR{g)d x u , where g oc d x u is the 
longitudinal rate. The viscosity factor R(g) is a solution to the differential 
equation (8.176), subject to a certain initial condition. Uribe and Pina [218] 
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have indicated some interesting features of the invariance equation (8.176) for 
the model of hard spheres. In particular, they have found that a numerical 
integration from the initial point into the domain of negative longitudinal 
rates is very difficult. What happens to the relevant solution for negative 
values of gl 

Let us denote as P = (g,R) the points in the (g,R) plane. The relevant 
solution R(g) emerges from the point Po = (0,4/3), and can be uniquely 
continued to arbitrary values of g, positive and negative. This solution can be 
constructed, for example, with the Taylor expansion, and which is identical 
with the relevant sub-series of the Chapman-Enskog expansion. However, 
the difficulty in constructing this solution numerically for g < 0 originates 
from the fact that the same point Po is the point of essential singularity of 
other (irrelevant) solutions to (8.176). Indeed, for \g\ <C 1 , let us consider 
R(g) = R(g)-\-A, where R(g) = (4/3) + (8/9) (7 — 2 )# is the relevant solution 
for small |g|, and A(g) is a deviation. Neglecting in (8.176) all regular terms 
(of the order g 2 ), and also neglecting gA in comparison to A, we derive the 
following equation: (1 — 'y)g 2 (dA/dg) = — (3/2)A The solution is A(g) = 
A(go) exp[a(g~ 1 — g^ 1 )], where a = (3/2)(l— 7) -1 . The essential singularity at 
g = 0 is apparent from this solution, unless A(go) 7 ^ 0 (that is, no singularity 
exists only for the relevant solution, R = R). Let A(go) 7 ^ 0. If g < 0, then 
A —> 0, together with all its derivatives, as g —■> 0. If g > 0, the solution 
blows up, as g —> 0 . 

The complete picture for 7 7 ^ 1 is as follows: The lines g = 0 and P = 
(< 7 , g- 1 ) define the boundaries of the basin of attraction A = (J A+, where 
A_ = {P | — oc < g < 0,P > g -1 }, and = {P|oo > g > 0, R < g -1 }. 
The graph G = (g,R(g)) of the relevant solution belongs to the closure of A, 
and goes through the points Po = (0,4/3), P_ = (— 00, 0), and P + = (00, 0). 
These points at the boundaries of A are the points of essential singularity of 
any other (irrelevant) solution with the initial condition P e A, P ^ Af]G. 
Namely, if P G 7l + , P ^ f] G, the solution blows up at Po, and attracts 
to P + . If P G A-, P ^ A- P| G, the solution blows up at P_, and attracts to 
Po- 

The above consideration is supported by a numerical study of (8.176). In 
Fig. 8 . 12 , it is demonstrated how the dynamic viscosity factor R(g) emerges 
as the attractor of various solutions to the invariance equation (8.176) [the 
case considered corresponds to hard spheres, 7 = 1/2]. The analytical ap¬ 
proximation (8.179) is also shown in Fig. 8.12. It provides a reasonable global 
approximation to the attractor for both positive and negative g. We conclude 
with a discussion. 

(i) The main feature of the above example of extending the hydrody¬ 
namic description into a highly non-equilibrium and nonlinear domain can 
be expressed as follows: this is an exact partial summation of the Chapman- 
Enskog expansion. “Partial” means that the relevant high-speed terms, dom¬ 
inating the other contributions in the limit of the high average velocity, were 
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Fig. 8.12. Viscosity factor as an attractor. Solid lines: numerical integration with 
various initial points (crosses). Two poorly resolved lines correspond to the initial 
conditions (—100, 0) and (—100, 3). Circles : Taylor expansion to the 5th order. Dots : 
the analytical approximation of (8.179). Dash : boundaries of the basin of attraction 


accounted to all orders of the original Chapman-Enskog expansion. “Exact” 
means that, though we have used the formally different route, the result is 
indeed the sum of the relevant sub-series of the original Chapman-Enskog 
expansion. In other words, if we now expand the function Rmm (g) (8.178) in 
powers of g , around the point g = 0, we obtain again to the corresponding 
series inside the brackets in (8.171). That this is indeed true can be checked 
up to the few lower orders straightforwardly, although the complete proof re¬ 
quires a more involved analysis. As the final comment to this point, we would 
like to stress a certain similarity between the problem considered above and 
the frequent situations in many-body problems: there is no single leading 
term ; instead, there is the leading sub-series of the perturbation expansions, 
under certain conditions. 

(ii) Let us discuss briefly the features of the resulting hydrodynamics. 
The hydrodynamic equations are now given by (8.166), (8.167), and (8.168), 
where a is replaced by a n \ (8.172). First, the correction concerns the non¬ 
linear regime, and, thus, the linearized form of the new equations coincides 
with the linearized Navier-Stokes equations. Second, the solution (8.178) for 
Maxwell molecules and the result of the approximation (8.179) for other mod¬ 
els suggest that the modified viscosity gR gives a vanishing contribution in 
the limit of very high values of the average velocity. This feature seems to 
be of no surprise: if the average velocity is very high in comparison to other 
characteristic velocities (in our case, to the heat velocity), no mechanisms 
of momentum transfer are relevant except for the transfer with the stream. 
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However, a cautious remark is in order since the original “kinetic” description 
are Grad’s equations (8.166) and not the Boltzmann equation. 

(iii) The invariance equation (8.176) defines the relevant physical solution 
to the viscosity factor for all values of g , and demonstrates an interesting 
phase-space behavior similar to those of finite-dimensional dynamical sys¬ 
tems. 


8.5 The Main Lesson 

Up to now, the problem of the exact relationship between kinetics and hy¬ 
drodynamics remains unsolved. All the methods used to establish this rela¬ 
tionship are not rigorous, and involve approximations. In this work, we have 
considered situations where hydrodynamics is the exact consequence of kinet¬ 
ics, and in that respect, a new class of exactly solvable models of statistical 
physics has been established. 

The main lesson we can learn from the exact solution is the following: The 
Chapman-Enskog method is the Taylor series expansion approach to solving 
the appropriate invariance equation. Alternative iteration methods are much 
more robust for solving this equation. Therefore, it seems quite important 
to develop approaches to the problem of reduced description based on the 
principle of dynamic invariance rather than on particular methods of solving 
the invariance equations. The exact solutions where these questions can be 
answered in all the quantitative details provide a sound motivation for such 
developments. 


9 Relaxation Methods 


The “large stepping” relaxation method for solution of the invariance equa¬ 
tion is developed. 


9.1 “Large Stepping” for the Equation 
of the Film Motion 


Relaxation method is an alternative to the Newton iteration method described 
in Chap. 6: The initial approximation to the invariant manifold Fq is moved 
with the film extension (4.5), 

FM = (l - P t<v )J(F t (y)) = A f{v) , 

until a fixed point is reached. The advantage of this method is a relative free¬ 
dom in its implementation: equation (4.5) needs not to be solved exactly, one 
is interested only in finding fixed points. Therefore, a “large stepping” in the 
direction of the defect, Ap( y ) is possible, while the termination point is de¬ 
fined by the condition that the vector field becomes orthogonal to A F ( y )- For 
simplicity, let us consider the procedure of termination in the linear approx¬ 
imation. Let Fo(y) be the initial approximation to the invariant manifold, 
and we seek the first correction, 

My) = F o(y) + n(y)A FoM , 

where function T\(y) has the dimension of time, and is found from the condi¬ 
tion that the linearized vector field attached to the points of the new manifold 
is orthogonal to the initial defect, 


{^F 0 (y)\a - Py)[J{ F o(y)) + T l{y){ D xJ)F 0 (y)^F 0 (y)])Fo(y) ~ 0 • (9- 1 ) 


Explicitly, 


n(y) = - 


_ i^Foiy) A-Fq(?/)) J*o (y) _ 

( A Fo(y)\{ D xJ) F 0 (y)\A Fo ( y )) Fo ( y ) 


(9.2) 


Further steps Tk(y) are found in the same way. It is clear from the above 
that the step of the relaxation method for the film extension is equivalent to 
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the Galerkin approximation for solving the iteration of the Newton method 
with incomplete linearization. Actually, the relaxation method was first in¬ 
troduced in these terms in [24]. It was implemented in the method of in¬ 
variant grids [105] for the grid-based numerical representations of manifolds 
(see Chap. 10). An idea of using the explicit Euler method to approximate 
the finite-dimensional inertial manifold was proposed earlier in [25]. In our 
approach the special choice of the projector field is important. For recent 
development of the numerical Euler-type methods for the solution of the 
invariance equation see [28]. 

The advantage of the equation (9.2) is the explicit form of the size of the 
steps Tk(y). This method was successfully applied to the closure problem in 
the context of the Fokker-Planck equation [24]. 


9.2 Example: Relaxation Method 
for the Fokker-Planck Equation 

We address here the problem of closure for the Fokker-Planck equation (FPE) 
(2.60) in a general setting. First, we review the maximum entropy principle 
as a source of suitable quasiequilibrium initial approximations for closures. 
We also discuss a version of the maximum entropy principle, valid for a near¬ 
equilibrium dynamics, and which results in explicit formulas for arbitrary 
potential U and diffusion matrix D. 

In this Example we consider the FPE of the form (2.60): 

d t W(x,t) = d x -{D-[Wd x U + d x W}} . (9.3) 

Here W(x, t ) is the probability density over the configuration space cc, at the 
time £, while U(x) and D(x) are the potential and the positively semi-definite 
(y - D ■ y > 0) diffusion matrix. 


9.2.1 Quasi-Equilibrium Approximations 
for the Fokker-Planck Equation 

The quasiequilibrium closures are almost never invariants of the true mo¬ 
ment dynamics. For corrections to the quasiequilibrium closures, we apply the 
method of invariant manifold, which is carried out (subject to certain approx¬ 
imations explained below) to explicit recurrence formulas for one-moment 
near-equilibrium closures for arbitrary U and D. As a by-product, these 
formulas provide also a method for computing the lowest eigenvalue of the 
problem, which dominates the near-equilibrium FPE dynamics. Results are 
tested with model potentials, including the FENE-like potentials [151-153]. 
A generalization of the present approach to many-moment closures is also 
straightforward. 
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Let us denote as M the set of linearly independent moments, 

{M 0 , Mi, ..., M/e}, where MJW] = J rrii(x)W(x) dx, mo = 1 . 

We assume that there exists a function bT*(M, x) which extremizes the en¬ 
tropy S (2.61) under the constraints of fixed M. This quasiequilibrium dis¬ 
tribution function may be written as 


W* 


W eq exp 


" k 

’^2A i m i (x) - 1 

_i=0 


(9.4) 


where A = {Mo, Mi,..., A^} are Lagrange multipliers. Closed-form equations 
for moments M are derived in two steps. First, the quasiequilibrium dis¬ 
tribution (9.4) is substituted into the FPE (9.3) or (2.62) to give a formal 
expression: 

d t W* = M w ,(5S/5W)\ w=w , 

, where Mw* is given by (2.62). Second, introducing the quasiequilibrium 
projector 77*, 

k 

II* • = Y^{dW*/dMi) 

i=0 

and applying 77* on both sides of the formal expression, we derive closed 
for M in the quasiequilibrium approximation. Further processing requires 
explicit solution to the constraints, f W*(M, x)rrii(x) dx = M^, to get the 
dependence of Lagrange multipliers M on the moments M. Though typically 
the functions M(M) are not known explicitly, one general remark about the 
moment equations is readily available. Specifically, the moment equations in 
the quasiequilibrium approximation have the form: 



k 

Mi = J2M* j (M)(dS*(M)/dM j ) , (9.5) 

i =o 

where aS*(M) = S[W*(M)] is the quasiequilibrium entropy, and where M*- 
is an M-dependent (k + 1) x (k + 1) matrix: 

M*j = J W*(M,x)[d x mi(x )] • D(x) ■ [d x mi(x)\ dx . 

The matrix M*- is symmetric, positive semi-definite, and its kernel is the vec¬ 
tor Thus, the quasiequilibrium closure reproduces the gradient structure 
on the macroscopic level (2.62), the vector field of quasiequilibrium equations 
(9.5) is a transform of the gradient of the quasiequilibrium entropy given by 
the symnmetric positive operator. 

The following version of the quasiequilibrium closures makes it possible to 
derive more explicit results in the general case [233,246-248]: In many cases, 
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one can split the set of moments M in two parts, M/ = (M 0 , Mi,..., M/} and 
Mn = {M/ + 1 ,..., M/e}, in such a way that the quasiequilibrium distribution 
can be constructed explicitly for Mj as Wj(Mj , x ). The full quasiequilibrium 
problem for M = {M/,M//} in the “shifted” formulation reads (see the 
“triangle entropy method” in Chap. 5): extremize the functional S[Wj + 
AW] with respect to AW, under the constraints M/[W/ + AW] = Mj and 
Mu[Wj -\-AW] = Mn. Let us denote as AMn = M/j —Mjj(Mj) deviations 
of the moments Mn from their values in the quasiequilibrium state Wj. For 
small deviations, the entropy is well approximated with its quadratic part 


AS : 


/ 


AW 


, , Wj 

1 + ln w L 

We q 


dx — - 


II 


AW 2 

~Wf 


dx 


Taking into account the fact that Mi[Wf] = Mi, we come to the following 
maximizaton problem: 


AS[AW] max , M/[Z\IT] = 0, M//[Z\IT] = AM/j . (9.6) 

The solution to the problem (9.6) is always explicitly found from a (fc + 1) x 
(k + 1) system of linear algebraic equations for Lagrange multipliers. This 
triangle entropy method for Boltzmann equations was discussed in details in 
Sect. 5.6. 

In the remainder of this section we deal solely with one-moment near- 
equilibrium closures: M/ = Mo, (i. e. Wj = W eq ), and the set Mn contains 
a single moment M = f mW dx, m{x) ^ 1. We shall specify notations for the 
near-equilibrium FPE, writing the distribution function as W = We q (l + *F), 
where the function IF satisfies an equation: 

dt* = w-pv , (9.7) 

where J = d x -\W eq D-d x ]. The triangle one-moment quasiequilibrium function 
reads: 

= w eq 

where 

ttt} 0 ) = [(mm) — (m) 2 ] _1 [m — (m)] . (9.9) 

Here brackets (...) = f Weq ... dx denote equilibrium averaging. The super¬ 
script (0) indicates that the triangle quasiequilibrium function (9.8) will be 
considered as the initial approximation to the procedure which we address 
below. Projector for the approximation (9.8) has the form 

777(0) r 

= IFgq —— 7 ——— / m^\x) • dx . (9.10) 

Substituting the function (9.8) into the FPE (9.7), and applying the projector 
(9.10) on both the sides of the resulting formal expression, we derive the 
equation for M: 


1 + AMm w 


(9.8) 
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M = —XqAM , (9.11) 

where 1/Ao is an effective relaxation time of the moment M to its equilibrium 
value, in the quasiequilibrium approximation (9.8): 

A 0 = (m ( °)m (l) ))- 1 (S I m (0 ) • D • 0 x m<°>) . (9.12) 

9.2.2 The Invariance Equation for the Fokker-Planck Equation 

Both the quasiequilibrium and the triangle quasiequilibrium closures are al¬ 
most never invariants of the FPE dynamics. That is, the moments M of solu¬ 
tions of the FPE (9.3) and the solutions of the closed moment equations like 
(9.5), are different functions of time, even if the initial values coincide. These 
variations are generally significant even for the near-equilibrium dynamics. 
Therefore, we ask for corrections to the quasiequilibrium closures to end up 
with the invariant closures. This problem falls precisely into the framework 
of the method of invariant manifold [11] (Chap. 6), and we shall apply this 
method to the one-moment triangle quasiequilibrium closure approximations, 
as a simple example. 

First, the invariant one-moment closure is given by an unknown distrib¬ 
ution function VE^ 00 ) = VE eq [l + AMm^°°\x)} which satisfies the invariance 
equation 

[1 - 77 (oo) ] Jm (oo) = 0 . (9.13) 

Here is the projector, associated with function m (oc) , and which is 

also yet unknown. Equation (9.13) is a formal expression of the invariance 
principle for a one-moment near-equilibrium closure: considering VE^ 00 ) as a 
manifold in the space of distribution functions, parameterized with the values 
of the moment M, we require that the microscopic vector field Jm (°°) be equal 
to its projection, 77(°°) onto the tangent space of the manifold W^°°\ 

Now we turn our attention to solving the invariance equation (9.13) it¬ 
eratively, beginning with the triangle one-moment quasiequilibrium approxi¬ 
mation bE(°) (9.8). We apply the following iteration process to (9.13): 

[l-77 (/c) ]Jm (/c+1) = 0, (9.14) 

where k = 0,1 ,..., and where m^ +1 ^ = m^ and the correction 

satisfies the condition (/ i ( fc + 1 ) m ( fc )) = o. The projector is updated after each 
iteration, and it has the form 


77 (fc+1) « = w eq 


ft) 

(m( /c+1 )m( /c + 1 )) 



Applying 17 (fc+1) to the formal expression, 

W eq m {k+1) M = AM[ 1 - i7 (fe+1) ]m (fc+1) , 


(9.15) 
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we derive the (k + l)th update of the effective time (9.12): 


(d x m^ k ^ • D • d x m^ k+1 ^) 
k+1 = (m( /c+1 )m( /c +i)) 


(9.16) 


Specializing to the one-moment near-equilibrium closures, and following the 
general argument of Chap. 6, solutions to the invariance equation (9.13) are 
eigenfunctions of the operator J, while the limit of the iteration process (9.14) 
is the eigenfunction which corresponds to the eigenvalue with the minimal 
nonzero absolute value. 


9.2.3 Diagonal Approximation 


In order to obtain more explicit results, we shall now proceed with to an 
approximate solution to the problem (9.14) at each iteration. The correction 
/i^ +1 ^ satisfyes the condition pS- k+1 ^) = 0, and can be decomposed as 
follows: fi^ k+1 ^ = + e^. Here e^) is the defect of the kth approxima¬ 

tion: e W = Wgq 1 [1 — n^]Jm^ = A+ R( k \ where 

R {k) = W^JmP* . (9.17) 

The function is orthogonal to both e^ and mP^ ((e^e^) = 0, and 

(m( fe )ej fe )) = 0). 

Our diagonal approximation (DA) consists in neglecting the part e^. In 
other words, we seek an improvement of the non-invariance of the kth ap¬ 
proximation along its defeck A = e^ k \ Specifically, we consider the following 
ansatz at the kth iteration: 


m O+l) _ m (k) _|_ ak6 ( k ) m 


(9.18) 


Substituting the ansatz (9.18) into (9.14), we integrate the latter expression 
with the functon e^ to evaluate the coefficient a^: 


<*k = 


Ah — A l 


A| — 2A kAk + Bk 


(9.19) 


where functions Ak and Bk are represented by the following equilibrium av¬ 
erages: 


A k = 

B k = • D • d x R^ k) ) . 


(9.20) 


Finally, putting together (9.16), (9.17), (9.18), (9.19), and (9.20), we arrive 
at the following DA recurrence solution: 
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m (fe+1) = m ( fe ) + a k [X k m (k) + R (k) ] , 

. _ Afe - (A k — A 1)otk 

k+1 - i + (A h - \IH ■ 


(9.21) 

(9.22) 


Notice that the stationary points of the DA process (9.22) are the true 
solutions to the invariance equation (9.13). What may be lost within the DA 
is the convergence to the true limit of the procedure (9.14), i.e. to the minimal 
eigenvalue. In a general situation this is highly improbable, though. 

In order to test the convergence of the DA process (9.22) we considered 
two potentials U in the FPE (9.3) with a constant diffusion matrix D. The 
first test was with the square potential U = x 2 /2, in the three-dimensional 
configuration space, since for this potential the spectrum is well-known. We 
have considered two examples of the initial one-moment quasiequilibrium 
closures with = x\ + 100(x 2 — 3) (example 1), and m = x\ + 100x 6 X2 
(example 2), in (9.9). The result of performance of the DA for A& is presented 
in Table 9.1, together with the error 5k which was estimated as the norm of 
the variance at each iteration: 5k = (e^e^) / (m^m^). In both examples, 
we see a good monotonic convergency to the minimal eigenvalue Aoo = 1, 
corresponding to the eigenfunction x\. This convergence is even striking in the 
example 1, where the initial choice was very close to a different eigenfunction 
x 2 — 3, and which can be seen in the non-monotonic behavior of the variance. 
Thus, we have an example to trust the DA approximation as converging to 
the proper object. 


Table 9.1. Iterations A& and the error 5k for U = x 2 /2 




0 

1 

4 

8 

12 

16 

20 

Ex. 1 

A 

1.99998 

1.99993 

1.99575 

1.47795 

1.00356 

1.00001 

1.00000 


(5 

0.16 • 10 -4 

0.66 • 10“ 4 

0.42 • 10 -2 

0.24 

0.35 • 10 -2 

0.13 • 10 -4 0.54 • 10 -7 



0 

1 

2 

3 

4 

5 

6 

Ex. 2 

A 

3.399 

2.437 

1.586 

1.088 

1.010 

1.001 

1.0002 


6 

1.99 

1.42 

0.83 

0.16 

0.29 • 10 -1 

0.27 • 10 -2 0.57 • 10 -3 


For the second test, we have taken a one-dimensional potential U = 
—501n(l — x 2 \ the configuration space is the segment \x\ < 1. Potentials 
of this type (a so-called FENE potential) are used in applications of the FPE 
to models of polymer solutions [151-153]. Results are given in Table 9.2 for 
the two initial functions, = x 2 + 10x 4 — (x 2 + 10x 4 ) (example 3), and 
777 / (°) = x 2 + 10x 8 — (x 2 + 10x 8 ) (example 4). Both examples demonstrate a 
stabilization of the A/~ at the same value after some ten iterations. 

In conclusion, we have developed the principle of invariance to obtain mo¬ 
ment closures for the Fokker-Planck equation (9.3), and have derived explicit 
results for the one-moment near-equilibrium closures, particularly important 
to get information about the spectrum of the FP operator. 
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Table 9.2. Iterations A& for U — — 501n(l — x 2 ) 




0 

1 

2 

3 

4 

5 

6 

7 

8 

Ex. 3 

A 

213.17 

212.186 

211.914 

211.861 

211.849 

211.845 

211.843 

211.842 

211.841 

Ex. 4 

A 

216.586 

213.135 

212.212 

211.998 

211.929 

211.899 

211.884 

211.876 

211.871 


9.3 Example: Relaxational Trajectories: 

Global Approximations 

Here we describe semi-analytical approximate methods for nonlinear space- 
independent dissipative systems equipped with the entropy functional. The 
key point of the analysis is an upper limiting state in the beginning of the 
relaxation. Extremal properties of this state are described, and explicit esti¬ 
mations are derived. This limiting state is used to construct explicit approx¬ 
imations of the trajectories. Special effort is paid to accomplish positivity, 
smoothness and the entropy growth along the approximate trajectories. The 
method is tested for the space-independent Boltzmann equation with various 
collision mechanisms. 

9.3.1 Initial Layer and Large Stepping 

For relaxing systems, it is a common place to distinguish three subsequent 
regimes on a way from an initial non-equilibrium state /o(E) to the final 
equilibrium state /°(T), where T is the phase variable: the early-time relax¬ 
ation immediately after the system leaves the initial state /o, the intermediate 
regime, and the final regression to the equilibrium state /°. This model pic¬ 
ture is only approximate. For gases, the early-time relaxation occurs in a 
few first collisions of the molecules, and can be singled out from the whole 
relaxational process and investigated separately. 

Considering the beginning of the relaxation, we may expect that it is 
dominated by a rate of processes in the initial state. In the case of a dilute 
gas, in particular, this rate is given by the Boltzmann collision integral, Q(/), 
evaluated in the state /o, and equal to Qo = Q(/o)- The latter expression is 
the known function of the phase variable, Qo(T). Put differently, our expec¬ 
tation is that states which the system passes through in the beginning are 
close to those on a ray, /(F, a): 

f{r, a) = fo{r) + aQo(r) , (9.23) 

where a > 0 is a scalar variable (we use dimensionless variables). It is clear 
that such an approximation can be valid if only a “is not too large”. On the 
other hand, nothing tells us ultimatively that a must be “strictly infinitesi¬ 
mal” if we want to obtain at least a moderate by accuracy approximation. In 
general, this consideration can be relevant if the parameter a in (9.23) does 
not exceed some certain upper value a*. 
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In this Example we give an answer to the following question: what is the 
upper limiting state, /*, the system cannot overcome when driven with the 
initial rate Q o? As long as we can consider Qo as the dominant direction in 
the early-time relaxation, the answer amounts to an upper estimate of the 
parameter a in (9.23), and thus the limiting state /* is: 

nr ) = f(r,a*) = fo(r) + a*Qo(r) , (9.24) 

where the value a* is the subject of the analysis to be performed. 

Our approach will be based on the following consideration. Denote as S(f ) 
the entropy of the state /(D), and as S(a ) its value in the state /(D, a) (9.23). 
A state /(D, a') can be regarded accessible from the initial state /(D, 0) = 
/o(D) in the course of the Qo-dominated dynamics, if and only if the function 
S(a) increases with an increase of the variable a from 0 to a'. The upper 
limiting value, a*, is thus characterized by the following two properties: 

1. S(a) increases, as a increases from 0 to a*. 

2. S(a ) decreases, as a exceeds a*. 

Assuming the usual convexity properties of the entropy, we conclude that 
the state /(D, a*) with these properties is unique. 

In the next subsection, “Extremal properties of the limiting state,” we 
derive an equation for the limiting state /(D, a*) in two ways: firstly, as a 
direct consequence of the two properties just mentioned, and, secondly, as 
an equilibrium state of an appropriately chosen kinetic model of the Qo- 
dominated relaxation. Next we introduce a method to obtain the explicit 
estimate of the function /(D, a*) (details are given in special Subsect. 9.3.5 
“Estimations”). With this, we get the answer to the question posed above. 

The derivation of the state /(D, a*) plays the key role in the section 
“Approximate phase trajectories”. There we aim at constructing explicit ap¬ 
proximations to trajectories of a given space-independent kinetic equation. 
Namely, we construct an explicit function /(D, a), where parameter a spans 
a segment [0,1], and which satisfies the following conditions: 

1. /(r,o) = f 0 (r). 

2 . f(r,i) = f°(r). 

3. /(D, a) is a non-negative function of D for each a. 

4. C(a) m C(f(a )) = const, where C(f) are linear conserved quantities. 

5. S(a) = S(f(a )) is a monotonically increasing function of a. 

6. 3/(D, a)/da\ a= o = A:Qo(D), where k > 0. 

Function /(D, a) is a path from the initial state /o to the equilibrium state f° 
(conditions 1 and 2). All states of the path make physical sense (condition 3), 
conserved quantities remain fixed, and the entropy monotonically increases 
along the path (conditions 4 and 5). Finally, condition 6 requires that the path 
is tangent to the exact trajectory in their common initial state /q. A function 
/(D, a) with the properties 1-6 is, of course, not unique but a construction of 
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a definite example is a rather non-trivial task. Indeed, the major difficulty is 
to take into account the tangency condition 6 together with the rest of the 
requirements. 

The simplest function with the properties 1-6, and which depends smoothly 
on a, is constructed explicitly in the Subsect. 9.3.3 “Approximate trajecto¬ 
ries” (details of the procedure are given in Subsect. 9.3.5). We also discuss 
the question of the time dependence /(T, a(t)). In the section “Relaxation of 
the Boltzmann gas”, the method is applied to the space-independent nonlin¬ 
ear Boltzmann equation for several collisional mechanisms. In particular, we 
compare our approximations with the celebrated BKW-mode [255,256,262] 
for the Maxwell molecules, and with solutions to the two-dimensional very 
hard particles model (VHP) [257,258]. 

Before to proceeding any further, it is worthwhile to give here a brief com¬ 
ment on the status of the approximate trajectories considered below. It is well 
known that the space-independent problem for dissipative kinetic equations 
is one of the most developed branches of kinetic theory with respect to ex¬ 
istence and uniqueness theorems [259-261]. The exact treatment of specific 
models is also avaiable [263,286]. On the other hand, there exists a gap of 
approximate semi-analytical methods in this problem. This is not surprising 
because most of the techniques of the kinetic theory [239] are based on a 
small parameter expansions, and this is simply not the case of the initial 
layer problem. The present study fills out this gap. Indeed, as the examples 
demonstrate, the smooth approximations /(a,T) constructed below provide 
a reasonable (and simple) approximation to the exact trajectories. 

Moreover, these functions serve for the initial approximation in an iter¬ 
ative method of constructing the exact trajectories for the dissipative sys¬ 
tems [26]. This method, in turn, is based on a more general consideration 
of the paper [11] (Chap. 6). We give additional comments on this iterative 
method below, as well as we provide an illustration of the correction. 


9.3.2 Extremal Properties of the Limiting State 


Let us first come to the equation for the limiting state /(T, a*) (9.24) in an 
informal way. The two features of the function /(T, a*) indicated above tell 
us that this is the state of the entropy maximum on the ray /(T, a) (9.23) 1 * . 
The extremum condition in this state reads: 


D f S \f=f(r,a *) 


( df(r,a) \ = f df(r,a) SS(f) 
\ da J J da Sf 


dr = o, 

f=f(r,a *) 


(9.25) 


where SS/Sf denotes the (functional) derivative of the entropy evaluated at 
the state /(T, a*). For a particularly interesting case of 


1 The entropy S(a) increases when a runs from zero to a*, and S(a) starts to 

decrease when a exceeds a *. 
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s B (f) = -1 /on in/CO dr 

(the Boltzmann entropy), and f Q(f) d r = 0 (conservation of the number of 
particles), (9.25) gives: 

J Qo(r) In {/ 0 (O + a *Qo(r)} dr = 0 . (9.26) 

In order to avoid a duplication of formulas, and in a view of the examples 
considered below, we shall restrict our consideration to the Boltzmann en¬ 
tropy case. The (unique) positive solution to (9.26) is the value a * which 
gives the desired upper estimate. 

In order to derive (9.26) more formally, an explicit presentation is re¬ 
quired for a model dynamics dominated by Qo- Let us introduce a parti¬ 
tion of the phase space into two domains, and T_, in such a way that 
the function Qo(r) is positive on /+, and is negative on F , and thus 
Qo(r) = Qq(F) — Qo (r), where both the functions Qq(F) and Qq (r) 
are positive and concentrated on F + and F_, respectively 2 . Let us consider 
the following kinetic equation: 


where 


dtf = k 1 (Q+(n 


(9.27) 

w ~(f) = ex p ^ 

j r Qo(n in/(r,t)drj , 

(9.28) 

w + (f) = exp ( 

Q+(r)\nf(r,t)dA , 



and ki > 0 is an arbitrary positive constant. When supplied with the initial 
condition f(JF, 0) = /o(T), equation (9.27) has a formal solution of the form: 


f(F,t) = fo(r)+a(t)Q 0 (r), (9.29) 


provided that a(t) is the solution of the ordinary differential equation 

= k 1 (w~(a ) - w + (a)) , 

with the initial condition a(0) = 0. Here w ± (a) = w ± (f(a)). 

The solution (9.29) describes a relaxation from the initial state /o to the 
equilibrium state /*, as t tends to infinity 3 . The entropy Sb monotonically 

2 For the Boltzmann collision integral, this partition should not be confused with 
the natural representation in the “gain—loss form” as f re(v / 1 v / |viv)(/ / /{ — 
ffi) dvidv'dvi. 

3 The equilibrium state /* of the model kinetic equation (9.27) is not the global 
equilibrium /°, exept for the BGK model of the collision integral. 
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increases along this solution up to the value S^ = Ss(/*) in the state /*. 
Substituting /* = /o + a*Qo into the right-hand side of (9.27), we derive the 
equation for the equilibrium state /* in the form of the detailed balance: 


w (a*) = rc + (a*) . 


(9.30) 


The latter equation is precisely (9.26). Note that the parameter k\ in (9.27) 
does not appears in the final result (9.26) since it is responsible only for the 
rate of the approach to the equilibrium state /* due to the dynamics (9.27) 
but not for the location of this state on the ray (9.23). 

Let us discuss the idea behind the model dynamics presented by (9.27). 
As long as we disregard any change of Q in the beginning of the relaxation, 
the function Qo(r) represents a distinguished direction of relaxation in the 
space of states. The partition of the phase space T + U T_ corresponds then 
to specification of the gain (T + ) and of the loss (T_) of the phase density, 
while the factors w + and w~ (9.28), 



(9.31) 


are the rates of the gain and and of the loss in the current state /, respectively. 
Equation (9.27) implements these processes in the familiar “gain minus loss” 
form, while the state /* corresponds to the balance of the gain and of the 
loss (9.30). One can also observe a formal analogy of the structure of (9.27) 
with that of the so-called Marcelin-De Donder equations of chemical kinetics 
[81,245] (see Chap. 2). 

Thus, the limiting state /* = /o + o is described as the equilibrium 
state of the kinetic equation (9.27), and solves (9.26). Note that the parameter 
a* is correctly defined by (9.26), independently of the partition introduced in 
the (9.27). The existence of the model relaxational equation (9.27) guarantees 
that /* is a physical state (/* is a non-negative function). 

In order to complete the analysis, we have to learn to solve the one¬ 
dimensional nonlinear equation (9.26). In general, a method of successive 
approximation is required to find the solution a* as a limit of a sequence 
a*, c& 2 ,.... Some care should be taken in order to get all the approximations 
a* not greater than the unknown exact value a*, since only the states /(a, T) 
with a < a* are relevant. Moreover, what one actually needs in computations 
is some definite approximation a\ < a*. In Subsect. 9.3.5, a corresponding 
method is developed, which is based on the partition of Qo introduced above. 
In particular, the first approximation a\ reads: 


1 - exp{— ctqM 


(9.32) 


a + f3 exp{— cto/q} 


where q , ctq, cq and /3 are numerical coefficients: 
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°o = -J QoOOln/oOOdr, 
g = j r Qt(r)dr = J^ Q 0 -(r)dr, 


(9.33) 




In the latter expressions, cr o is the entropy production in the initial state, q 
is the normalization factor, a and /3 reflect the maximal loss and the total 
gain of the phase density in the initial state, respectively. Finiteness of the 
parameters collected in (9.33) gives a restriction on the initial state /o for 
wich the estimate (9.32) is valid. 

9.3.3 Approximate Trajectories 

In this subsection we shall demonstrate how to use the states /* (9.24) 
in the problem of constructing the approximate trajectories of the space- 
independent relaxational equations 


dtf = Q(f) • 


(9.34) 


Here Q(f) is a kinetic operator (the collision integral in the case of the Boltz¬ 
mann equation). We assume that (9.34) describes a relaxation to the global 
equilibrium state /°(T), and the entropy S#(/) increases monotonically along 
the solutions. Let ci(T),... Ck(r ) be the conserved densities, i.e. 



Then the quantities Ci(f ) = /c*/dT are conserved along the solution. As¬ 
sume that the set of conserved densities ci(T),... Cfe(T) is full. In this case 


k 


in /°(r) = 5>Ci(r), 


1 


where cq are some numbers. A standard example of (9.34) is the space- 
independent Boltzmann equation which we consider below. 

Let /(T, t) be the solution to (9.34) with the initial condition /(T, 0) = 
/o(-T). The trajectory of this solution can be represented as a function /(T, a), 
where a varies from 0 to 1. For each a, the function /(T, a) is a non-negative 
function of T, and 
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/(r,o) = / 0 (r), f(r,i) = f°(r), 

j<k(r)f(r,a)dr = const, d a f(r,a) I o=0 OC Q 0 {r) . (9.35) 


In other words, as a varies from zero to one, the states /(T, a) follow the solu¬ 
tion /(T, t ) as t varies from zero to infinity. Since the entropy increases with 
time on the solution /(T, £), the function Sb(o) = Ss^fip)) is a monoton- 
ically increasing function of the variable a. This condition, as well as the 
conditions (9.35), must be met by any method of constructing an approxi¬ 
mation to the trajectory /(T, a) (see the conditions 1-6 in the Introduction). 

The simplest approximation based on the function /* of the preceding 
section can be constructed as follows: 


/(/» 


(l-2a)/o(r) + 2a/*(r) for 0 < a < \ 

2(l-a)/*(r) + (2a-l)/°(r) for | < a < 1 ' 


This approximation amounts to the two-step relaxation from the initial state 
fo to the equilibrium state f° through the intermediate state /* (9.24). The 
first step (parameter a increases from 0 to 1 / 2 ) is the relaxation directed 
along Q o up to the state /* (9.24). The second step (parameter a increases 
from 1/2 to 1 ) is the linear relaxation from /* towards the equilibrium state. 
The last step can be viewed as the trajectory of a solution to the equation, 


dtf = ~k 2 (f - f°) , 


(9.37) 


with the initial condition /* (9.24). In kinetic theory, equation of the form 
(9.37) is known as the BGK-model (2.17). The entropy increase along the 
second step is due to the well known properties of the equation (9.37). 

Expression (9.36) demonstrates the advantage of using the state /* for 
the purpose of approximating the trajectory: all the conditions (9.35) are 
obviously satisfied, and also we do not worry about the entropy increase. 
Thus, all the conditions 1-6 mentioned in the Introduction are satisfied by 
the approximation (9.36) due to the features of the state /*. For explicit 
expressions the estimate (9.32) can be used. 

A disadvantage of the two-step approximation (9.36) is its non-smoothness 
at a = 1/2. This can be improved as follows: Let us consider a triangle T 
formed by the three states, /o, /*, and /°, i.e. a closed set of convex linear 
combinations of these functions 4 . This object allows to use a geometrical lan¬ 
guage. A simple consequence of the properties of the state /* is that all the 
elements of the triangle T are non-negative functions, and if / belongs to T 
then Ci(f ) = Ci(/o), where i = 1 ,..., k (all the conservation laws are fixed 
in the triangle). Therefore, a better approximation to the trajectory can be 
constructed as a smooth curve inscribed into the triangle T in such a way 
that: 

4 The state / belongs to T if / = a±fo + -\-a 3 f 0 , where a; > 0, and a± + + 

ci3 = 1 - 
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1. It begins in the state fo at a = 0; 

2. It is tangent to the side Lf 0 f* = {f\f = a\fo + < 22 /*, Q>i > 0, > 0, ai + 

a 2 = 1} in the state /o; 

3. It ends in the equilibrium state /° at a = 1. 

Notice that the approximation (9.36) corresponds to the path from fo to /° 
over the two sides of the triangle T : firstly, over the segment between / 0 and 
/*, and, secondly, over the segment between /* and /°. 

The simplest form of such a smooth curve reads (the MDD spline): 

fg{r,a) = f° + (1 - a 2 ){ag(f* - f 0 ) + fo ~ f 0 } , (9.38) 


where g, 0 < g < 1 , is a parameter which has to be determined in a way that 
the entropy 5s(a), calculated in the states (9.38), is monotonically increasing 
function of a. The explicit sufficient method to estimate the value of para¬ 
meter g in (9.38) is rather non-trivial, and it is developed in Subsect. 9.3.5. 

Finally, let us consider briefly a question of the time dependence for the 
approximation /(T, a). Clearly, this question is relevant as soon as one looks 
for the approximate trajectories directly, rather than integrating (9.34) in 
time 5 . The answer assumes a dependence a(£), and requires an ordinary dif¬ 
ferential equation for a. Such an equation should be obtained upon substi¬ 
tution of the expression /(T, a) into the originating kinetic equation (9.34), 
and by a further projecting. Specifically, the equation for a{t) has a form: 

I <p(r, a ) df( £ a) d r = J ip(r,a)Q(f(r,a))dr , (9.39) 


where integration with the function ip(r, a) establishes the projection opera¬ 
tion. Usually, this is achieved by some moment projecting (ip is independent 
of a), but this choice is arbitrary. Another possibility is to use the thermody¬ 
namic projector (Chap. 5). Then (9.39) becomes the entropy rate equation 
along the path (9.38): 


da d Sb(cl) 
d t da 


a B {a) , 


(9.40) 


where S B (a) = -f f(r, a) In f(r, a) dr 
and a B (a) = -f Q(f(r, a)) In f(r, a) dr 

are the entropy and the entropy production in the states f(r,a) (9.38), re- 
spectively. 

A further consideration of (9.40) is beyond the scope of this Example. 
Nevertheless, let us consider the asymptotics of (9.40) for the motion from 
fo towards /*. As above, we take /(T, a) = (1 — a)fo + a/*. Equation (9.40) 
for this function gives: 


This question is typical to various approximations used in the kinetic theory 

[9,11]. 


5 
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a (t )~ —t, s«i 
a* 

(T* 

a (t) ~ , \/t, l-a«l, 

(a*) z K 0 

o 2 

where is the entropy production in the state /*, and Kq = J dr. The 
slowing down at the final stage is due to the fact that dSs(a)/da —► 0, as 
a —> 1, and > 0. 

9.3.4 Relaxation of the Boltzmann Gas 

The direct and the simplest application of the approach is the space- 
independent Boltzmann equation. In what follows, r is the velocity v, and 
f(r) is the one-body distribution function, /(v), which obeys the the equa¬ 
tion: 

dtf(y,t) = Q(f) , (9.41) 

with Q(f) the Boltzmann collision integral. 

In the first example we consider the following form of the collision integral 

Q(f) = j dw j dn 7 (g-n){/(v , ,l)/(w',t) -/(v, i)/(w, f)} , (9.42) 

where the function 7 depends only on the scalar product of unit vectors 
g = and n = while v' = |(v + w + n|v - w|), and w' = 

|(v+w — n|v—w|). The Boltzmann equation (9.41) with the collision integral 
(9.42) corresponds to the power-law repelling potential inversly proportional 
to the fourth degree of the distance (the 3D Maxwell molecules, see e.g. [261]). 
The reason to consider this model is that it admits the exact solution, the 
famous BKW-mode discovered by Bobylev [262], and by Krook and Wu [255, 
256]. The BKW-mode is the following one-parametric set of the distribution 
functions /(c, v): 

^ C ' V "> = \{~P) ex p|-^-| ((5- 3c )+ c (c-i)^ 2 ) > (9- 43 ) 

where the parameter c spans the segment [1, |[, the value c = 1 corresponds 
to the equilibrium Maxwell distribution 

/°(v) = /(l,v) = (27t) -3 / 2 exp{— v 2 /2} . 

As c decays from a given value Co, where 1 < Co < 5/3, to the value c = 1, 
the functions /(c, v) (9.43) describe the trajectory of the BKW-mode (the 
time dependence of c is unimportant in the present context, see e.g. [286]). 

Considering the states (9.43) as the initial states in the procedure de¬ 
scribed above, we can construct the upper limiting states, /*(c, v) = /(c, v) + 
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a*(c)Q(c, v), for each value of c. First, we compute the collision integral (9.42) 
in the states (9.43) and obtain the functions Q(c, v): 

Q(c,v) = ^( c-1 ) 2 exp|-^-| (15 - 10cu 2 + c 2 (v 2 ) 2 ) , (9.44) 

where A is a constant: A = | f dn 7 (k • n)(l — (k • n) 2 ). 

Expression (9.44) suggests a simple structure of the velocity space par¬ 
tition into the domains V+(c) and VL(c) (corresponding to the domains T± 
(9.31)). Namely, for a given c, the function (9.44) is positive inside a sphere 

of radius V-(c) = yj c _1 (5 — \/T()), and outside a larger sphere of radius 

v+(c) = yj c _1 (5 + aAO) (both the spheres are centered in v = 0), while it is 
negative inside the spheric layer between these spheres: 


V-(c) = {v | v-(c) < |v| < u + (c)} , (9.45) 

V+( c ) = ( v I v-(c ) > |v|} U {v | |v| > u+(c)} . 


The limiting states /*(c, v) are given by the following expression: 



x (5 — 3c + 15a*(c) + (c — 1 — 10a*(c))cu 2 + a*(c)c 2 (u 2 ) 2 ) , 
where a*(c) is a solution to (9.26): 

/Q( C ,v)ln(/(c,v) + a * ( c)^,) dv = 0 . (9.47) 


Taking into account the partition (9.45), all the parameters (9.33) are 
expressed by definite one-dimensional integrals. Thus, we obtain the first 
approximate a*(c). Numerical results are presented in Table 9.3 (second col¬ 
umn) for the three values of the parameter c taken on the BKW mode. 
It is interesting to compare a\(c) with a max (c), for which the function, 
looses positivity (i.e., this function becomes negative for 
some v, as a > a max (c)). The ratio a^(c)/a max (c) is given in the third column 
of Table 9.3. The step in the direction Q(c, v) which is allowed due to the 
entropy estimate reasons is never negligible in comparison to that determined 
by the positivity reasons, as seen in Table 9.3. 

We now use (9.46) to get the approximations of trajectories (9.36) and 
(9.38). The estimation of the parameter g in the expression (9.38) according 
to Subsect. 9.3.5 gives the value g = 1 for all the initial states (9.43). 

In order to make a comparison with the exact result (9.43), we have 
considered the dependencies of the normalized moments rrik(mi ), where 
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Table 9.3. The limiting states for the Maxwell molecules 


c 

at 

& 1 / C-max 

1.12 

3.1779-10" 3 

0.2221 

1.24 

1.1660-10“ 2 

0.4291 

1.48 

3.8277- 10" 2 

0.7087 


m s (f) 


fifTf dv 

/(v 2 ) s /° dv ’ 


s = 0,1,2,... ■ 


(9.48) 


Typical dependencies of the higher-order moments (k > 3) on the lowest- 
order non-trivial moment (/ = 2) are presented in the Fig. 9.1 for a consider¬ 
ably nonequilibrium initial state (9.43) with c = 1.42. 

The error of the approximation (9.38) was estimated as follows: In each 
moment plane (ra^, mi), the approximation (9.38) and the BKW-mode (9.43) 
generate two sets (two curvilinear segments), X^i and Y^i , respectively. First, 
in order to eliminate the contribution from the difference in the total variation 
of the moments, we rescale the variables: 


where 


rhi = rrii/Ai , i = k, / , 


Ai = max I Xi — x'A . 
x.x'eXfciU Y kl 


Second, in the plane (rhk,rhi), we compute the Hausdorff distance, d&/, be¬ 
tween the two corresponding sets, Xm and Ykl'- 

d ki = max < max min d(x, y), max min d(x, y) > , (9.49) 

lx£X k i yeYki yeY k i*eX k i J 


where d(x, y) is the standard Euclidian distance between two points, 
the error Ski was estimated as the normalized distance d^: 

Ski = * 100 % , 

Y>kl 


Finally, 

(9.50) 


where 

D k i = max ^ d(x, y) . 

x,y eY k i 1J X k i 

The error 5k 2 of the plots like in Fig. 9.1 is presented in the Table 9.4 for 
several values of the parameter c. 

The quality of the smooth approximation (9.38) is either good or reason¬ 
able up to the order of the moment k ~ 10, depending on the closeness of the 
initial state to the equilibrium, when either k increases, or the initial state is 
taken very far from the equilibria (i.e., when c is close to 5/3) the comparison 
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(a) m3 VS. 7712, 



(b) 7718 VS. 7712, 

Fig. 9.1. Moment dependencies for the Maxwell molecules: The initial state /o is 
the function (9.43) with c = 1.42. Punctuated contour is the image of the triangle 
T. Punctuated dash line is the BKW-mode. Solid line is the smooth approximation 
(9.38). Punctuated path /o —► /* —> f° is the non-smooth approximation (9.36) 
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Table 9.4. The error 5k 2 (9.50) of the approximation (9.38) for the Maxwell mole¬ 
cules with the initial data (9.43) 


k 

c — 1.12 

c — 1.24 

c — 1.36 

c — 1.48 

c — 1.59 

3 

0.31 

0.33 

0.30 

0.41 

0.70 

4 

0.44 

0.47 

0.44 

0.81 

1.57 

5 

0.58 

0.55 

0.71 

1.41 

2.67 

6 

0.71 

0.57 

1.10 

2.20 

3.97 

7 

0.81 

0.62 

1.58 

3.14 

5.40 

8 

0.89 

0.84 

2.19 

4.19 

6.93 

9 

0.95 

1.11 

2.87 

5.34 

8.52 

10 

0.99 

1.41 

3.64 

6.55 

10.11 

20 

1.46 

6.77 

12.91 

18.15 

22.87 

50 

10.38 

28.47 

27.36 

30.81 

33.94 

100 

21.76 

29.26 

32.49 

34.78 

37.22 


becomes worser. For the moments of a very high order, the approximation 
with the smooth function (9.38) is only qualitative. On the other hand, the 
two-step (non-smooth) approximation (9.36) provides a much better approx¬ 
imation for higher-order moments (fc ^ 40 and higher). The explanation is as 
follows: the BKW-mode (9.43) demonstrates a very rapid relaxation of higher 
moments to their equilibrium values. Therefore, as expected, the relaxation 
in the direction Qo leads to the state where the higher-order moments are 
practically the same as in the equilibrium. 

The second example is the very hard particles (VHP) model [257,258]. 
The distribution function F(x) depends on the phase variable x, where 0 < 
x < 00 , and is governed by the following kinetic equation: 

poo rU 

d t F(x,t)= / d u d y[F(y,t)F(u-y,t)-F(x,t)F(u-x,t)} . (9.51) 

Jx Jo 

This model has the two conservation laws: 

POO 

N = I F(x,t) dx = 1 , 

Jo 

POO 

E m J xF(x,t) dx = 1 , 

Jo 

and has the entropy Sb{F) = — J 0 °° F(x) InF(x) dx. The equilibrium dis¬ 
tribution reads: F°(x) = exp(— x). The general solution to this model is 
known [257,258,286]. 

The first set of initial conditions which was tested was as follows: 

F 0 (x, (3) = P((2 - /?) + P(f3 - l)x) exp(-/fo) , (9.52) 

where 1 < P < 2, the value P = 1 corresponds to the equilibrium state 
Fq{x, 1) = F°(x). 
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In accordance with [257,258,286], the exact solution solution to (9.51) 
with the initial data (9.52) reads: 


F ex (x,f3,t) = 


Az + + C 


z+ — z_ 


e xz+ + 


Az_-hC 
-e 


(9.53) 


t + 2/3 

Z± = -x- ± 


t + 2/3 




2 V V 2 

A = l — (/3 — l) 2 e- t ; C = £ + 2/3 - 1 + e _t (/3 - l) 2 . 


Comparison of the smooth approximation (9.38) with the exact solution 
(9.53) demonstrates the same quality as in the case of the Maxwell mole¬ 
cules. As above, the normalized moments rrik were compared, where 

/ 0 °° x k F(x ) dx 
k J 0 °° x k F°(x) dx 

In Table 9.5, the error Sk 2 (9.50) is represented for several values of the 
parameter /?, while Fig. 9.2 illustrate the typical moment behavior. We also 
represent in this figure the result of the correction to the approximation (9.38) 
due to the first iteration of the Newton method with incomplete linearization 
(Chap. 6). 


Table 9.5. The error 5k 2 (9.50) of the approximation (9.38) for the VHP model 
with the initial data (9.52) 



k 

4 

6 

8 

10 

20 

100 

0 = 

1.2 

0.95 

1.81 

2.26 

2.23 

2.24 

9.64 

0 = 

1.6 

0.88 

1.89 

2.59 

2.77 

6.14 

24.29 

0 = 

1.9 

1.16 

1.65 

1.45 

3.16 

12.7 

28.22 


The second set of the initial conditions for the VHP model (9.51) was 
considered as follows: 


F 0 (x, A) = exp(-2x) jl + + 2x 2 (l - A) + 


(9.54) 


where 0 < A < 1/5(7 +a/ 19)- The exact solution to (9.51) with the initial con¬ 
dition (9.54) was found in [258]. This solution demonstrates so-called Tjon’s 
overshoot effect [264]. We remind that Tjon’s effect takes place when the 
distribution function becomes overpopulated for some velocities in compari¬ 
son to both the initial and the equilibrium states. This effect was intensively 
studied for solvable Boltzmann-like kinetic equations, such as the Maxwell 
molecules (9.42), the VHP model (9.51), and others (see [286], [265] and 











268 9 Relaxation Methods 



Fig. 9.2. Moment dependency mio vs. m 2 for the VHP model with the initial 
condition (9.52), (3 = 1.5. Dots - the exact solution (9.53); Bold line is the smooth 
approximation (9.38); Solid line is the first correction to the approximation (9.38) 


references therein; it is worthwhile to mention here extensive studies of the 
Tjon-like effects in chemical kinetics [81,115]). 

The approximation (9.38) for the VHP model (9.51) with the initial con¬ 
dition (9.54) also demonstrates the overshoot just mentioned. In the moment 
representation, the overshoot of the moments is clearly seen in Fig. 9.3. The 
quality of the approximation is the same as in the examples above. 


9.3.5 Estimations 

This is the technical subsection which contains estimations for the limiting 
state and for the smooth approximation of the trajectory. 

Evaluation of the Limiting State. Double-Space Newton Method 

Let us introduce a normalization of the partition Q±(r): 

q±(r) = q-'Qtin , q = [ Q±(C) dr . (9.55) 

Jr± 

Switching to the variable b = qa , so that /* = fo(r) + b*qo(r ), where 
qo{r) = q~ 1 Qo(r ), equation (9.26) can be rewritten as follows: 


A+(b*) = A-(b*) 


(9.56) 
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(a) A = 0.6 



Fig. 9.3. Moment dependencies ttiq vs. m3 for the VHP model with the initial 
condition (9.54). Solid line is the exact solution [258], Bold line is the smooth 
approximation (9.38) 
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where 

A±(b) = f q±(r) ln(/ 0 (r) ± bqf(r)) d r . (9.57) 

Jr± 

It is easy to check the following properties of the functions A± (9.57): 

1. The domain of A + is the open semi-axis ]b+,+oo[, where b + < 0, and 
domain of A_ is the open semi-axis ] — oo, b_ [, where b_ > 0. The functions 
A± have logarithmic singularities at points b±, respectively. 

2. The functions A± are monotonic and concave inside their domains. 

3. An inequality holds as: A+(0) — A_(0) = —q~ l cr o < 0, where <Jo = 
— f Qo{r ) ln/ 0 (T) dr is the entropy production in the state /q. 

One has to solve (9.56) in order to obtain approximations b*, b^, ... not 
greater than the unknown exact value b*. To obtain a relevant lower estimate 
of b*, it is convenient to use the concavity properties of the functions (9.57). 
Indeed, for positive b, the function A_ is estimated from below as: 

A-(b) > A_(0) + ln(l - oqb) . (9.58) 

Here a\ is the inverse of b_: 


ai re?- fo(n 


Qoin 


= sup 

rer_ ^Jo(T) 


= q 1 a 


while a was introduced in (9.33). 

On the contrary, the function should be estimated from above. Note 
that a function expA + is also monotonic and concave. We can write for 
positive b: 

.dA+(0)' 


where 


A+(b) ^ A-|-(0) + In ( 1 + b 


db 


(9.59) 


dA+{ 0) 
db 


L 


fo(n 


d r = q~ 1 /3, 


and /3 was introduced in (9.33). 

Equating the right-hand side of (9.59) to the right-hand side of (9.58), 
and solving the linear equation obtained, we get the estimate b\ < b*. Next, 
switching back to the variable a, we get the estimate a\ (9.32) and (9.33). 
One can readily recognize that the procedure just described is the first iterate 
of the Newton method for (9.56) (modified by making use of the concavity 
to guarantee positivity of the approximate solution, a\ < a*). We call it 
the double-space Newton method. Next iterations are performed in the same 


manner. 
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Smooth Approximations of the Trajectories 


The Triangle of Model Motions 


Notation conv{/i,..., /&} stands for a closed convex linear hull of the func¬ 
tions and we drop the variable T. In particular, the triangle T 

introduced in the section “Approximate trajectories” reads: 

T = conv{/o, /*, /°} . (9.60) 

A function from the triangle T (9.60) can be specified with two parameters, 
£ and T), as f(tv)- 

fitv) = f° + £{v(f* ~ fo) + /o - f°}, 0<^,jy<l. (9.61) 

A shift of the function /(£, 77 ) under a variation of £ and of 77 reads: 

A fit v) = <%/(£> v)A£ + d v fit r])Ar) + o(At Arj) 

= if (tv) ~ /°)V 1 + a*Q 0 £Ar) + o(At Arj) . 

This shift is a combination of the two: a shift towards f°, and a shift in the 
direction Q q. We further refer to these as to the BGK-motion and the Qq- 
motion, respectively. The differential of the entropy Sb(£,v) = *S(b(/(£? ??)) 
is: 

d S B (t V) = ~<ri(t V)^ 1 d£ + (?2(t v)€ d V > (9-62) 

where 

<*i(tv) = j ( fit V)~f°) In hTA dr , (9.63) 

*2(tv) = j (fo - /*) In fit V) d-T = -a* J Q 0 ]nf(tv)dT , 

are the entropy productions in the BGK-motion and in the Qo-motion, re¬ 
spectively. 

Introducing smooth dependencies, £(a) and 77 (a), where 0 < a < 1, and 
requiring 


0 < t a ),v(a) < 1 , £( 0 ) 
dg(a) 

da 


= 1. £(i) 

= 0, 

a=0 


= 0, r ,( 0) 

d?](a) 


0, 77 ( 1 ) < oc , (9.64) 

7, 0 < 7 < 1 , 


we obtain a one-parametric set, /(a) = /(^(a), 77 (a)). Geometrically, /(a) is 
a smooth curve located in T. This curve begins in /o at a = 0, ends up in 
/° at a = 1, and is tangent to the side of T, Lf 0 f* = conv{/o, /*}, at a = 0. 
Further, only monotonic functions £(a) and 77 (a) will be considered: 


d£(a) 


< 0 , 


dr?(o) 


> 0 . 


da 


da 


(9.65) 
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The crucial point is that the function /(a) should have a correct en¬ 
tropy behavior. Specifically, we require that the entropy Sb(cl) = (/(&)) = 

5# (/(£(&), ??(&))) is a monotonic function: 


d S B (a) 


= - 0-1 (t(a),T](a))t (a) 


d£(a) 


+ 02 (£(a),r?(a))£(a) 


dri(a) 


> 0 . 


da da da 

(9.66) 

Since <Ji(£, 77 ) is non-negative everywhere in T, a sufficient condition for 
inequality (9.66) to be valid for any pair of functions £(a) and 77 (a) with the 
properties (9.64) and (9.65) is that cr 2 (£, 77 ) is non-negative everywhere in T. 
However, this situation might not always be realized for arbitrary /o and (Jo¬ 
in order to take into account a general situation, we execute the following 
procedure: 


1. We derive a subset of T, inside which 02 is non-negative. This subset 
includes /o, and will be constructed as a triangle T' C T. 

2 . We tune the functions £(a) and 77 (a) in such a way that cri(a) dominates 
( 72 (a) outside T'. 


The Triangle T f 


Let us introduce a different specification of the functions in the triangle T. 
Denote 


h(y) — (1 -y)fo + yf*, f2(y) = 0 --y)fo + yf°, o<y<i. (9.67) 

The functions in T are labeled with two parameters, x and y: 

f(x,y) = Ci--x)f 1 (y)+xf 2 (y), 0 < x,y < 1 . (9.68) 

Let us derive 7 /, where 0 < y' < 1, in such a way that a 2 is non-negative 
everywhere in the triangle T' = conv{/o, /i(t/), /2 (?/)}• 

Introducing a representation cr 2 (^, 2/) = cr^ix^y) — cr^"(x,7/), where 

at (+ y) = J fo ln fi. x , y ) dr, <^2 (+ y) = j f * ln /(+ v) dr > ( 9 - 69 ) 

we notice that the functions (j^(x,7/) are concave in the variable y on the 
segment [0,1], for any fixed x. Now we apply the standard estimations of a 
smooth concave function on [0,1] (if dd t 2 < 0 on [0,1], then ^(t) > 
(1 — 0) + t 2 p( 1), and 2 p(t) < (d ^(t)/dt\ t =o)t + -0(0)) to the functions 

(9.69): 


i x > v) > (! - (*, 0) + (x, 1), 

0-2“ (+ y) < (^^ 0 + y)\y=o)y + <*f Or o). 

Furthermore, the function (x, 1) is concave, hence 
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a+(x, 1 ) > (1 - x)a+( 0 , 1 ) + xa+( 1 , 1 ) . 

Making use of the three inequalities just derived, and taking into account the 
explicit form of the function /(x, 7 /), we are led to the following estimate of 
(72 in T: 

{x,y) > a*cr 0 - y(xKi + K 2 ) , (9.70) 

where do is the entropy production in the initial state (9.33), and parameters 
K\ and K 2 are: 

R i = J ^(f°-ndr + S B (f°)-S B (n, ( 9 . 71 ) 

r 2 = I £(r-/ 0 )dr+5 B (r)-5 B (/o) . 

Here $ b (/ o ), * Sb (/*) 5 and Ssif 0 ) are values of the entropy in the states /o, 
/*, and /°, respectively. 

Since do is positive, there always exists such y ', where 0 < y' < 1 , that 
the right-hand side of (9.70) is non-negative for all x on the segment [0,1]. 
Specifically, let us introduce a function cp(x ) = a*do — (xKi + K 2 ), and denote 

z = aV 0 min^- 1 , (K, + i^)” 1 } , (9.72) 

where min {K^ 1 , ( R i + R 2 )~ 1 } stands for the minimal of the two numbers, 
K2 1 and ( I\ \ + if^) -1 . Then y' is defined as: 

/ _ f 1 if f( x ) — 0 on [ 0 , 1 ], or z>l (g _ 

y \z otherwise ’ \ • J 

Thus, d 2 is non-negative inside the triangle T f = conv{/o, /hG/)}? 

where are given by (9.67), and y r is given by (9.73). If it happens that 

y' = 1, then T f = T, and d 2 is non-negative everywhere in T. In this case any 
pair of the functions £(a) and 77 (a) with the properties (9.64) and (9.65) give 
the approximation /(a) consistent with the inequality (9.66). Otherwise, we 
continue the procedure. 

Near-Equilibrium Estimations of the Functions cr\ and cr^ 

Let us come back to the specification (9.61) in order to establish the following 
inequalities for the functions (£, 77 ) (9.63): 

pi (t;,v)>M 1 e, 

C 2 (£,??) > M 2 £ . 

Inequalities (9.74) are motivated by the following consideration. Since 

/(£,»?) ->• f°, as £ —> 0 , 


(9.74) 
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parameter £ controls a deviation of /(£, 77 ) from f° in T. Near the equilibrium 
state /°, the function cri(£, 77 ) is quadratic in £, while the function 02 (£, 77 ) is 
linear. Inequalities (9.74) extend these near-equilibrium estimations to other 
points of T, and they are intended to control dominance of o\ over 02 outside 
T' in the case T' 7 ^ T. 

Writing 0 q(£, 77 ) = £A(£,77), and representing A(£, 77 ) as a combination of 
the concave functions, and after making the estimations as above, we come 
to the following expression for M\ in the first of the inequalities (9.74): 

M! = S B (f°) - S B (n . (9.75) 

Since Ss(/°) > expression (9.75) is always positive. The estimate of 

M2 is much the same. First, representing 02 (£, 77 ) in the manner of (9.69), and 
again estimating the concave functions obtained, we come to the following 
inequality: 



02 (£,»?) > ^(^77i +N 2 ) , 

(9.76) 

where constants N± and N2 are: 


■V, = 

f ^(/o - n d r + 5 b (/o) - S B (f*) , 

(9.77) 

N 2 = s 

f ^(f°-fo)dr + s B (f 0 )-s B (f°). 



Second, denoting min{A^ 2 , N\ + N2} as the minimal of the two numbers, N2 
and Ni + N2, we derive the constant in the second of the inequalities (9.74): 


M 2 = min{A^ 2 , N2} (9.78) 


As above, there are two possibilities: 

1. If M2 > 0, then d2 is non-negative everywhere in T, and any pair of 
functions £(a) and 77 (a) with the properties (9.64) and (9.65) gives /(a) 
with the correct entropy behavior. 

2. If M2 < 0, then we continue the procedure. 

Adjustment of the Functions £(a) and 77 (a) 

Let y' < 1 and M2 < 0 . A further analysis requires an explicit form of the 
functions £(a) and 77 (a) with the properties (9.64) and (9.65), and can be 
done in any particular case. Consider the simplest choice: 

£(a) = 1 - a 2 , r?(a) = ga , (9.79) 

where g, 0 < g < 1, is a parameter to be determined. The function (9.61) 
with the dependencies (9.79) has the form (9.38): 

fg(a) = /° + (1 - a 2 ){ga(f* - f 0 ) + fo ~ /°} • 


(9.80) 


9.3 Example: Relaxational Trajectories: Global Approximations 275 


We should derive the parameter g in (9.79) in such a way that the states 
/(a) (9.38) belong to T', when a varies from 0 to some ai, and also that 
G\ (a) dominates ( 72 (a) when a varies from a\ to 1. Under these conditions, 
the entropy inequality (9.66) is valid for all a on the segment [0,1]. 

Substitute now (9.79) into (9.66) and apply the inequalities (9.74) to get: 


6.Sb (a) > 2a(l — a 2 )Mi — g( 1 — a 2 ) 2 |M 2 | . (9.81) 

We require that /(ai) E conv{/i(?/), / 2 (?/)}, an d fh a f th e right-hand side of 
the inequality (9.81) is non-negative at a\\ 


/ f g (a 1 ) = f(x u y') 

\ 2 a(l-a 2 )Mi-^(l-a 2 ) 2 |M 2 | >0 ' 


(9.82) 


Here f(xi,y') is the specification (9.68) of the function f g (a\). Explicitly, 
condition (9.82) reads: 


{ a\ = x 1 y' 

ai 5(1 - «i) = (1 - xi)y’ . (9.83) 

<7(1 - a?) < 


Eliminating a\ and x\ in 
the parameter g: 


(9.83), we are left with the following estimate of 


9 < A 


yV(! + 

1 - y' + A 


(9.84) 


where 


2 M\ 
IM2I ' 


(9.85) 


It may happen that the right-hand side of the inequality (9.84) is greater 
than 1. In this case we take g = 1 in (9.80). Thus, if y’ < 1, and M 2 < 0, the 
parameter g in (9.80) and (9.38) is estimated as: 


g = min 


1, A 


VV(1 + A) 1 
1 - y’ + A J ’ 


(9.86) 


Summary of the Algorithm 


The choice of the parameter g in the smooth approximate to the trajectory 
(9.38) is done in the following four steps: 

1. Evaluate K\ and K 2 (9.71). 

2. If a*do — (K\x + K 2 ) > 0 on [0,1], take g — 1. Otherwise, evaluate 

y' = a*a 0 (Ki + K 2 )~ 1 } ■ 

3. If y r > 1, take g = 1. Otherwise evaluate N\ and N 2 (9.77). 
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4. If min{A^ 2 , A^i + 7V 2 } > 0, take g = 1. Otherwise evaluate M\ (9.75) and 


take 



The function f g {a ) (9.38) with g thus derived has the following properties: 

1. It begins in /o at a = 0 and ends in f° at a = 1. 

2. It is a non-negative function of r for each a. 

3. It satisfies the conservation laws. 

4. The entropy 5s (/^ (a)) is a monotonic function of a. 

5. It is tangent to the exact trajectory at a = 0. 

In practical computations, the approximation /* = /o + a^Qo with a\ 
(9.32) can be used in this algorithm instead of the exact /*. 

9.3.6 Discussion 

Main results of this Example are: 

1. The description of the Qo-dominated kinetics, and of its equilibrium state 
/*. The state /* is explicitly evaluated. 

2. The explicit construction of the approximate trajectory /(T, a) for nonlin¬ 
ear space-independent kinetic equations equipped with the entropy (Lya¬ 
punov) function. 

The approach used can be termed “geometric” since it avoids integration 
of kinetic equations in time. In the point 1, it stays at variance with many 
alternative approaches to the early-time evolution, which usually involve the 
time integration over the first few collisions. These methods encounter two 
general difficulties: the time of integration cannot be defined precisely, and 
approximations involved can violate the entropy increase and the positivity of 
distribution function. These difficulties are avoided in the present approach. 
On the other hand, the presentation of the Qo-dominated relaxation is itself 
an ansatz, whose relevance to the actual process can be judged only a pos¬ 
teriori. As the examples show, we can indeed speak about such a dynamics. 
It is remarkable that the limiting state /* differs significantly from both the 
initial and equilibrium states. In other words, irrespectively of how short in 
time the initial stage of the relaxation might be, the change of the state can 
be large. 

Concerning the point 2, it is worthwhile to notice that, though the space- 
independent problem is too “refined”, it nevertheless gives a good example of 
a problem without small parameters. It is rather remarkable that the global 
requirements to the trajectory (e.g., the entropy increase) are accomplished 
with the direct local analysis (Subsect. 9.3.5). Estimations in this part are 
sufficient, and can be enhanced. 
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Final comments concern a further treatment of the space-independent 
relaxation. The goal now is to develop a procedure of corrections to the 
approximate trajectory. In other words, what we need is a sequence of the 
functions /o(T, a), /i(T, a),..., which converges to the exact trajectory, and 
where /o(T, cl) is the initial (global) approximation to the trajectory. Again, a 
general obstacle is the absence of a small parameter in the problem. However, 
the method of invariant manifold (Chap. 6) appears to be appropriate (at 
least formally) since it is based on the Newton method and not on the small 
parameter expansions. It turns out that smoothness and all the requirements 
listed in the Introduction should be met by any initial approximation /o (T, a) 
chosen for this procedure. Thus, the approximation (9.38) can be used for 
this purpose. We have already annonsed this method with a result of the 
first Newton correction to the approximation (9.38) for the VHP model (see 
Fig. 9.2). 

Finally, the present method recently became a part of the so-called En- 
tropic lattice Boltzman method [136,137,140,141] (see Sect. 2.7) because it 
enables to implement collision in a numerically stable fashion. 


10 Method of Invariant Grids 


The method of invariant grids is developed for a grid-based computation of 
invariant manifolds. 


10.1 Invariant Grids 

Elsewhere above in this book, we considered the immersions F(y), and the 
methods for their construction, without addressing the question of how to 
implement F numerically. In most of the works (of us and of other people 
on similar problems), analytic forms were required to represent manifolds 
(see, however, the method of Legendre integrators [254,266,369]). However, 
in order to construct manifolds of a relatively low dimension, grid-based rep¬ 
resentations of manifolds become a relevant option. The method of invariant 
grids (MIG) was suggested recently in [22]. 

The main idea of MIG is to find a mapping of the finite-dimensional grids 
into the phase space of a dynamic system. That is, we construct not just a 
point approximation of the invariant manifold F*(y ), but an invariant grid. 
When refined, it is expected to converge, of course, to F*(y ), but in any case 
it is a separate, independently defined object. 

Let’s denote L = R n , G is a discrete subset of R n . It is natural to think of a 
regular grid, but this is not so crucial. For every point i/GG, a neighborhood 
of y is defined: V y C G, where V y is a finite set, and, in particular, y G V y . 
On regular grids, V y includes, as a rule, the nearest neighbors of y. It may 
also include the points next to the nearest neighbors. 

For our purpose, we should define a grid differential operator. For every 
function, defined on the grid, also all derivatives are defined: 

= qi(z,y)f(z),i = l,...n . (10.1) 

zev y 

where qi(z,y) are some coefficients. 

Here we do not specify the choice of the functions qi(z, y). We just mention 
in passing that, as a rule, (10.1) is established using some approximation of / 
in the neighborhood of y in R n by some differentiable functions (for example, 
polynomials). This approximation is based on the values of / at the points of 


dl 

dyi 
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V y . For regular grids, qi(z, y) are functions of the difference z — y. For some of 
the nodes y which are close to the edges of the grid, functions are defined only 
on the part of V y . In this case, the coefficients in (10.1) should be modified 
appropriately in order to provide an approximation using available values of 
/. Below we assume this modification is always done. We also assume that 
the number of points in the neighborhood V y is always sufficient to make the 
approximation possible. This assumption restricts the choice of the grids G. 
Let’s call admissible all such subsets G, on which one can define differentiation 
operator in every point. 

Let F be a given mapping of some admissible subset G C R n into U . For 
every y G V we define tangent vectors: 


T y = Lin{gi }” , 


( 10 . 2 ) 


where vectors gi{i = 1,... n) are partial derivatives (10.1) of the vector- 
function F: 

9i= g- = Yi <n( z ’V) F ( z ) , (!0.3) 

zeVy 

or in the coordinate form: 


(9i)j 


n{ z ^y) F 3{ z ) ■ 

zev y 


(10.4) 


Here (g%)j is the jth coordinate of the vector (^), and Fj{z ) is the jth coor¬ 
dinate of the point F(z). 

The grid G is invariant , if for every node y G G the vector field J{F{y)) 
belongs to the tangent space T y (here J is the right hand side of the kinetic 
equations (3.1)). 

So, the definition of the invariant grid includes: 

1. The finite admissible subset G C R n ; 

2. A mapping F of this admissible subset G into U (where U is the phase 
space of kinetic equation (3.1)); 

3. The differentiation formulas (10.1) with given coefficients qi(z,y ); 

The grid invariance equation has a form of an inclusion: 


J(F(y)) G T y for every y G G , 
or a form of an equation: 


(1 - P y )J(F{y)) = 0 for every y G G , 

where P y is the thermodynamic projector (5.25). 

The grid differentiation formulas (10.1) are needed, in the first place, to 
establish the tangent space T y , and the null space of the thermodynamic 
projector P y in each node. It is important to realize that the locality of the 
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construction of the thermodynamic projector enables this without a global 
parametrization. 

Basically, in our approach, the grid specifics is in: (a) differentiation for¬ 
mulas, (b) grid construction strategy (the grid can be extended, contracted, 
refined, etc.) The invariance equations (3.3), equations of the film dynamics 
extension (4.5), the iteration Newton method (6.2), and the formulae of the 
relaxation approximation (9.2) do not change at all. For convenience, let us 
rewrite all these formulas in the grid context. 

Let x = F(y) be the location of the grid’s node y immersed into U . We 
have the set of tangent vectors gi(x ), defined in x (10.3), (10.4). Thus, the 
tangent space T y is defined by (10.2). Also, one has the entropy function 
S'(x), the linear functional D X S\ X , and the subspace T Gy = T y fj ker D X S\ X in 
T y . Let To y T y . In this case we have a vector e y E T y , orthogonal to To y , 
D x S\ x (e y ) = 1. Then the thermodynamic projector is defined as: 

P y 9 = P 0y • +e y D x S\ x 9 , (10.5) 


where Po y is the orthogonal projector on To y with respect to the entropic 
scalar product (|) x . 

If Toy = T y , then the thermodynamic projector is the orthogonal projector 
on T y with respect to the entropic scalar product (|) x . 

For the Newton method with incomplete linearization, the equations for 
calculation the new node location x' = x + Sx are: 

\ (1 - Py){J(x) + DJ(x)Sx) = 0 . 

Here DJ(x) is a matrix of derivatives of J evaluated at x. The self-adjoint 
linearization can be used too (see Chap. 7). 

Equation (10.6) is a system of linear algebraic equations. In practice, it 
proves convenient to choose some orthonormal (with respect to the entropic 
scalar product) basis bi in ker P y . Let r = dim(kerP y ). Then Sx = Yli=i 
and system (10.6) takes the form 


| DJ(x)b k ) x = ~(J(x) | bi) x ,i = l...r . (10.7) 

k=1 


This is the system of linear equations for adjusting the node location 
according to the Newton method with incomplete linearization. 

For the relaxation method, one needs to calculate the defect A x = (1 — 
P y )J{x ), and the relaxation step 


t{x) 


(^x\^x)x 

(A x \DJ(x)A x ) x 


( 10 . 8 ) 


Then, the new node location x' is computed as 
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x' = x + r{x)A x . 


(10.9) 


This is the equation for adjusting the node location according to the 
relaxation method. 


10.2 Grid Construction Strategy 

From all the reasonable strategies of the invariant grid construction we con¬ 
sider here the following two: the growing lump and the invariant flag. 


10.2.1 Growing Lump 

The construction is initialized from the equilibrium point y*. The first ap¬ 
proximation is constructed as F(y*) = x*, and for some initial Vo ( V y * C Vo) 
one has F(y) = x* + A(y — y*), where A is an isometric embedding (in the 
standard Euclidean metrics) of R n in E. 

For this initial grid one makes a fixed number of iterations of one of 
the methods chosen (Newton’s method with incomplete linearization or the 
relaxation method), and, after that, puts Vi = [j ye y 0 V y and extends F from 
Vo onto Vi using the linear extrapolation, and the process continues. One of 
the possible variants of this procedure is to extend the grid from Vi to V $+1 
not after a fixed number of iterations, but only after the invariance defect A y 
becomes less than a given e (in a given norm, which is entropic, as a rule), 
for all nodes y G V. The lump stops growing after it reaches the boundary 
and is within a given accuracy ||Z\|| < e. 


10.2.2 Invariant Flag 

In order to construct the invariant flag one uses sufficiently regular grids G, 
in which many points are located on the coordinate lines, planes, etc. One 
considers the standard flag R° C R 1 C R 2 C ... C R n (every next space is 
constructed by adding one more coordinate). It corresponds to a sequence of 
grids {?/*} C G 1 C G 2 ... C G n , where {y*} = R °, and G i is a grid in R\ 

First, y* is mapped on x* and further F(y *) = x*. Then the invariant 
grid is constructed on V 1 C G 1 (up to the boundaries and within a given 
accuracy ||Z\|| < e). After that, the neighborhoods in G 2 are added to the 
points V 1 , and the grid V 2 C G 2 is constructed (up to the boundaries and 
within a given accuracy) and so on, until V n C G n is constructed. 

While constructing the kth-order grid V k C G k , the important role of the 
grids of lower dimension V° C ... C V k ~ x C V k embedded in it, is preserved. 
The point F(y*) = x* (equilibrium) remains fixed. For every y G V q (q < k) 
the tangent vectors #i, ... , g q are constructed, using the differentiation oper¬ 
ators (10.1) on the whole V k . Using the tangent space T y = Lin{gy ... ,g q }, 
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the projector P y is constructed, the iterations are applied and so on. All this 
is done in order to obtain a sequence of embedded invariant grids, given by 
the same map F. 

10.2.3 Boundaries Check and the Entropy 

We construct grid mapping of F onto a finite set V G G. The technique of 
checking whether the grid still belongs to the phase space U of the kinetic 
system (F(V) C U) is quite straightforward: all the points y G V are checked 
whether they belong to U . If at the next iteration a point F(y) leaves I/, then 
it is pulled inside by a homothety transform with the center in x *. Since the 
entropy is a concave function, the homothety contraction with the center in 
x* increases the entropy monotonically. Another variant to cut off the points 
which leave U. 

By construction (5.25), the kernel of the entropic projector is annulled 
by the entropy differential. Thus, in the first order, the steps in the Newton 
method with incomplete linearization (6.2) as well as in the relaxation method 
(9.1), (9.2) do not change the entropy. But if the steps are quite large, then 
the increase of the entropy may become essential, and the points are returned 
on their entropy levels by the homothety contraction with the center in the 
equilibrium point. 


10.3 Instability of Fine Grids 

When one reduces the grid spacing in order to refine the grid, then, once 
the grid spacing becomes small enough, one can face the problem of the 
Courant instability [269-271]. Instead of converging, at every iteration the 
grid becomes more and more entangled (see Fig. 10.1). 

A way to avoid such instability is well-known. This is decreasing the time 
step. In our problem, instead of a true time step, we have a shift in the 
Newtonian direction. Formally, we can assign the value ft = 1 for one complete 
step in the Newtonian direction. Let us extend now the Newton method to 
arbitrary h. For this, let us find Sx = SF(y) from (10.6), but update Sx 
proportionally to h; the new value of x n+ i = F n +i(y) is equal to 

F n +i(y) = F n {y) + h n 5F n (y) (10.10) 

where n denotes the number of iteration. 

One way to choose the step value h is to make it adaptive, by controlling 
the average value of the invariance defect ||Z\ y || at every step. Another way 
is the convergence control: then ^ h n plays a role of time. 

Elimination of the Courant instability for the relaxation method can be 
done quite analogously. Everywhere the step h is maintained as large as it is 
possible without running into convergence problems. 
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Fig. 10.1. Grid instability. For small grid steps approximations in the calculation of 
grid derivatives lead to the grid instability effect. Several successive iterations of the 
algorithm without adaptation of the time step are shown that lead to undesirable 
“oscillations”, which eventually destroy the grid starting from one of its ends 


10.4 Which Space is Most Appropriate 
for the Grid Construction? 

For kinetic systems, there are two distinguished representations of the phase 
space: 

- The density space (concentrations, energy or probability densities, etc.) 

The space of conjugated intensive variables, (temperature, chemical po¬ 
tentials, etc.) 

The density space is convenient for the construction of the quasi-chemical 
representations. Here the balance relations are linear and the constraints are 
in the form of linear inequalities (the densities themselves or some of their 
linear combinations must be positive). 

The conjugated variables space is convenient in the sense that the equilib¬ 
rium conditions are linear in terms of the conjugate variables. In these spaces 
the quasiequilibrium manifolds exist in the form of linear subspaces and, vice 
versa, linear balance equations turn out to be equations of the conditional 
entropy maximum. 

The duality we have just mentioned is well-known and studied in detail in 
many works on thermodynamics and Legendre transformation [274,275]. This 
viewpoint of nonequilibrium thermodynamics unifies many well-established 
mesoscopic dynamical theories, as for example the Boltzmann kinetic theory 
and the Navier-Stokes-Fourier hydrodynamics [189]. To this end, preceding 
the grids in the density space were discussed. However, the use of the space 
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of conjugated variables seems to be even more appealing for the grid con¬ 
struction. The main argument is the specific role of quasiequilibrium, which 
a linear manifold in the conjugated space. Therefore, a linear extrapolation 
gives a thermodynamically justified quasiequilibrium approximation. A lin¬ 
ear approximation of the slow invariant manifold in the neighborhood of the 
equilibrium in terms of the conjugate variables space already gives the readily 
global quasiequilibrium manifold which corresponds to the motion separation 
in the neighborhood of the equilibrium point. 

For the mass action law, transition to the conjugate variables is simply 
the logarithmic transformation of the coordinates. 


10.5 Carleman’s Formula 

in the Analytical Invariant Manifolds Approximations. 
First Benefit of Analyticity: Superresolution 

When constructing invariant grids, one must define the differential operators 
(10.1) for every grid’s node. For calculating the differential operators in some 
point 7/, an interpolation procedure in the neighborhood of y is used. As a 
rule, it is an interpolation by a low-order polynomial, which is constructed 
using the function values in the nodes belonging to the neighbourhood of y in 
G. This approximation (using values in the nearest neighborhood nodes) is 
natural for smooth functions. But we are looking for the analytical invariant 
manifold (see discussion in Chap. 4). Analytical functions have a much more 
“rigid” structure than the smooth ones. One can change a smooth function in 
the neighborhood of any point in such a way, that outside this neighborhood 
the function will not change. In general, this is not possible for analytical 
functions: a kind of a “long-range” effect takes place (as is well known) . 

The idea is to make use of this effect and to reconstruct some analytical 
function fc using a function given on G. There is one important requirement: 
if the values given on G are values of some function / which is analytical 
in a neighborhood [/, then, if the G is refined “correctly”, one must have 
fc —► / in U. The sequence of reconstructed function fc should converge to 
the “right” function /. 

What is the “correct refinement”? For smooth functions for the conver¬ 
gence fc —> / it is necessary and sufficient that, in the course of refinement, G 
would approximate the whole U with arbitrary accuracy. For analytical func¬ 
tions it is necessary only that, under the refinement, G would approximate 
some uniqueness set 1 A C U. Suppose we have a sequence of grids G, each 
next is finer than the previous, which approximate a set A. For smooth func¬ 
tions using function values defined on the grids one can reconstruct the func¬ 
tion in A. For analytical functions, if the analyticity domain U is known, and 


1 Let’s remind to the reader that A C U is called uniqueness set in U if for 
analytical in U functions ip and ip from ip \a = p \a it follows ip = (p. 



286 10 Method of Invariant Grids 


A is a uniqueness set in U, then one can reconstruct the function in U. The 
set U can be essentially bigger than A; because of this such extension was 
named as superresolution effect [276]. There exist formulas for construction 
of analytical functions fc for different domains [/, uniqueness sets A C U 
and for different ways of discrete approximation of A by a sequence of refined 
grids G [276]. Here we provide only one Carleman’s formula which is the most 
appropriate for our purposes. 

Let domain U = Q™ C C n be a product of strips Q a C C, Q a = {z\lmz < 
a}. We shall construct functions holomorphic in Q™. This is effectively equiv¬ 
alent to the construction of real analytical functions / in the whole R n with 
a condition on the convergence radius r(x) of the Taylor series for / as a 
function of each coordinate: r{x) > a in every point x G R n . 

The sequence of refined grids is constructed as follows: let for every l = 
1, ... , n a finite sequence of distinct points iVj C Q a be defined: 


Ni = {x tj \j = 1,2,3...},x tj ^ Xu for j (10.11) 

The countable uniqueness set A, which is approximated by a sequence of 
refined grids, has the form: 

A = N 1 xN 2 X...xN n = {(xii 1 ,X2i 2 ,- ■ ■ = 1,2,3,...} (10.12) 

The grid G m is defined as the product of initial fragments Ni of length 


Gm — { 5 ' • • ^ni n ) I f — ^} (10.13) 

Let us denote A = 2cr/7r (a is a half-width of the strip Q a ). The key role 
in the construction of the Carleman’s formula is played by the functional 
cUm(u,p,l) of 3 variables: u G U = Q™, p is an integer, 1 < p < m, / is an 
integer, 1 < p < n. Further u will be the coordinate value at the point where 
the extrapolation is calculated, l will be the coordinate number, and p will be 
an element of multi-index {H, ... ,i n } for the point (xu 1 ,X2i 2 , ■.. ,x n i n ) G 
G: 


U?n(u,P,l) = 


xip _|_ gA xip ^ ^gAu gA xip ^ 

A(e Aw + e Xxi p)(u — xi p )e Xxi p 

TL x ip e Xxij^ e Xu _ e Xxij ^ 

^gA xip _ gXxij ^ ^gAix _|_ gA xij\ 


n 


(10.14) 


j=ij^p 

For real-valued x p k formula (10.14) simplifyes: 


u^(u,p,i) = 2 


a Xu _ c Xx 


gAXip 


n 


( e xXip _|_ e Xxij\f e Xu _ gA x tj \ 


X(e Xu + e Xxi p)(u — xi v ) ^ RXxip _ e Xxij\( e Xu q. e Xxij\ 

(10.15) 

The Carleman formula for extrapolation from Gm on U = Q™ (a = nX/2) 
has the form (z = (zi, ... , z n )): 
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fm(z)= ^ (10.16) 

k\. — ,/c n —1 j —1 

where k sa £q,..., k n , x k = (x lkl ,x 2k2 , • • • ,x nkn ). 

There exists a theorem [276]: 

If f e # 2 (Q™), then f(z ) = where H 2 {Q 1 f) is the Hardy 

class of holomorphic in Qff functions. 

It is useful to present the asymptotics of (10.16) for large \Rezj\. For this 
purpose, we shall consider the asymptotics of (10.16) for large \Reu\: 


01 





g A xip g A Xij 


+ o(|Re^| x ) . 


(10.17) 


From the formula (10.16) one can see that for the finite m and |R ezj | —> oo 
function \f m {z)\ behaves like const • Ylj \ z j\~ 1 - 

This property (zero asymptotics) must be taken into account when using 
the formula (10.16). When constructing invariant manifolds F(W), it is nat¬ 
ural to use (10.16) not for the immersion F(y), but for the deviation of F(y) 
from some analytical ansatz F G (y) [277-280]. 

The analytical ansatz Fo(y) can be obtained using Taylor series, just as 
in the Lyapunov auxiliary theorem [3] (see also Chap. 4). Another variant is 
to use Taylor series for the construction of Pade-approximations. 

It is natural to use approximations (10.16) in terms of dual variables as 
well, since there exists for them (as the examples demonstrate) a simple and 
effective linear ansatz for the invariant manifold. This is the slow invariant 
subspace F7 s iow of the operator of linearized system (3.1) in dual variables 
at the equilibrium point. This invariant subspace corresponds to the set of 
“slow” eigenvalues (with small | Re A |, Re A < 0). In the space of concentrations 
this invariant subspace is the quasiequilibrium manifold. It consists of the 
maximum entropy points on the affine manifolds of the form x + Ef as t, where 
-E/fast is the “fast” invariant subspace of the operator of the linearized system 
(3.1) at the equilibrium point. It corresponds to the “fast” eigenvalues (large 
|ReA|, ReA < 0). 

Carleman’s formulas can be useful for the invariant grids construction in 
two places: first, for the definition of the grid differential operators (10.1), 
and second, for the analytical continuation of the manifold from the grid. 


10.6 Example: Two-Step Catalytic Reaction 

Let us consider a two-step four-component reaction with one catalyst A 2 (the 
Michaelis-Menten mechanism): 


A\ + A 2 <-> A3 A 2 + A4 . 


( 10 . 18 ) 
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We assume the Lyapunov function of the form 

s = -G = ~ c^Mci/cf) - 1] ■ 

i=1 

The kinetic equation for the four-component vector of concentrations, c = 
(ci, C2, C3, c 4 ), has the form 

c = 7^1 + 7 2 VL 2 . (10.19) 

Here 7 1?2 are stoichiometric vectors, 

Ti = (“1, "1,1, 0) , 72 = (0,1, -1,1) , (10.20) 

while functions Wi j2 are reaction rates: 

Wi = kf cic 2 - fcf c 3 , W 2 = c 3 - k 2 c 2 c 4 . (10.21) 

Here kf 2 are reaction rate constants. The system under consideration has 
two conservation laws, 


c i + c 3 + c 4 — Bi 5 c 2 + c 3 — , (10.22) 

or (&i j 2 ,c) = 5i > 2 , where 61 = (1,0,1,1) and bi = (0,1,1,0). The non¬ 
linear system (10.18) is effectively two-dimensional, and we consider a one¬ 
dimensional reduced description. For our example, we chosed the following 
set of parameters: 

kf = 0.3 , fcf = 0.15 , k 2 = 0.8, k 2 = 2.0 ; 

cf = 0.5 , c 2 q = 0.1, 4 q = 0.1 , cf = 0.4 ; (10.23) 

B x = 1.0, B 2 = 0.2 

The one-dimensional invariant grid is shown in Fig. 10.2 in the (ci,c 4 ,c 3 ) 
coordinates. The grid was constructed by the growing lump method, as de¬ 
scribed above. We used Newton iterations to adjust the nodes. The grid was 
grown up to the boundaries of the phase space. 

The grid in this example is a one-dimensional ordered sequence {aq,..., 
x n }. The grid derivatives for calculating the tangent vectors g were taken as 
g(xi) — (xi+i—Xi-i)/\\xi+i—Xi-i\ \ for the internal nodes, and g(x\) = (x\ — 
X 2 )/\\x\ - X 2 W, g{x n ) = (x n - x n -i)/\\x n - x n -ill for the grid’s boundaries. 

Close to the phase space boundaries we had to apply an adaptive algo¬ 
rithm for choosing the time step h: if, after the next growing step (adding 
new nodes to the grid and after completing N = 20 Newtonian steps, the 
grid did not converged, then we choose a new step size h n +% = h n /2 and 
recalculate the grid. The final (minimal) value for h was h ~ 0.001. 

The location of the nodes was parametrized with the entropic distance to 
the equilibrium point measured in the quadratic metrics given by the matrix 
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Fig. 10.2. One-dimensional invariant grid ( circles ) for the two-dimensional chemi¬ 
cal system. Projection into the 3d-space of ci, C 4 , C 3 concentrations. The trajectories 
of the system in the phase space are shown by lines. The equilibrium point is marked 
by the square. The system quickly reaches the grid and further moves along it 


H c = —\\d 2 S(c)/dcidcj\\ in the equilibrium c eq . It means that every node is 
located on a sphere in this metrics with a given radius, which increases lin¬ 
early with number of the node. In this figure the step of the increase is chosen 
to be 0.05. Thus, the first node is at the distance 0.05 from the equilibrium, 
the second is at the distance 0.10 and so on. Figure 10.3 shows several impor¬ 
tant quantities which facilitate understanding of the object (invariant grid) 
extracted. The sign on the x-axis of the graphs at Fig. 10.3 is meaningless 
since the distance is always positive, but in this situation it indicates two 
possible directions from the equilibrium point. 

Figure 10.3a,b represents the slow one-dimensional component of the dy¬ 
namics of the system. Given any initial condition, the system quickly finds 
the corresponding point on the manifold and starting from this point the 
dynamics is given by a part of the graph on the Fig. 10.3a,b. 

One of the useful quantities is shown on the Fig. 10.3c. It is the relation 
between the relaxation times “toward” and “along” the grid (A 2 /A 1 , where 
Ai, A 2 are the smallest and the next smallest by absolute value non-zero eigen¬ 
value of the system, symmetrically linearized at the point of the grid node). 
The figure demonstrates that the system is very stiff close to the equilibrium 
point (Ai and A 2 are well separated from each other), and becomes less stiff 
(by order of magnitude) near the boundary. This leads to the conclusion that 
the one-dimensional reduced model is more adequate in the neighborhood 
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Fig. 10.3. One-dimensional invariant grid for the two-dimensional chemical sys¬ 
tem. (a) Values of the concentrations along the grid, (b) Values of the en¬ 
tropy and the entropy production (— dG/dt) along the grid, (c) Ratio of the 
relaxation times “towards” and “along” the manifold. The nodes positions are 
parametrized with entropic distance measured in the quadratic metrics given by 
H c — — \ \d 2 S(c)/dcidcj\\ in the equilibrium c eq . Entropic coordinate equal to zero 
corresponds to the equilibrium 
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of the equilibrium where fast and slow motions are separated by two orders 
of magnitude. On the end-points of the grid the one-dimensional reduction 
ceases to be well-defined. 


10.7 Example: Model Hydrogen Burning Reaction 


In this section we consider a more complicated example, where the concentra¬ 
tion space is 6-dimensional, while the system is 4-dimensional. We construct 
an invariant flag which consists of 1- and 2-dimensional invariant manifolds. 

We consider a chemical system with six species called H 2 (hydrogen), 
O 2 (oxygen), H 2 O (water), H , O, OH (radicals). We assume the Lyapunov 
function of the form S = —G = — Y^= 1 / c l, q ) — !]• The subset of the 

hydrogen burning reaction and corresponding (direct) rate constants have 
were taken as: 


1. 

Ho <-! 

> 2 H 


k+~- 

= 2 

2. 

02 * 

20 


k+ = 

= 1 

3. 

h 2 o 

^ H 

+ OH 

k+ = 

= 1 

4. 

h 2 + 

O <-> 

H + OH 

ki = 

= 10 3 

5. 

o 2 + 

H ^ 

O + OH 

k+-- 

= 10 3 

6. 

h 2 + 

O ^ 

h 2 o 

L.+ _ 
- 

= 10 2 


The conservation laws are: 


2 ch 2 + 2 ch 2 o +ch + coh = bn 
2 cq 2 + CH20 + co + cqh = bo 


(10.25) 


For parameter values we took bn = 2, bo = 1, and the equilibrium point: 


cg 2 = 0.27 eg = 0.135 c^ 0 = 0.7 eg = 0.05 eg = 0.02 cg H = 0.01 

(10.26) 

Other rate constants , i = 1... 6 were calculated from c eq value and 
kf. For this system the stoichiometric vectors are: 

7i = (-1,0,0, 2,0,0) 72 = (0, - 1 , 0,0, 2,0) 

73 = (0,0, -1,1,0,1) 74 = (-1,0,0,1, -1,1) (10.27) 

75 = (0,-1,0,-1,1,1) 7 6 = (-1,0,1,0,-1,0) 


The system under consideration is fictitious in the sense that the subset 
of equations corresponds to the simplified picture of this chemical process 
and the rate constants do not correspond to any experimentally measured 
quantities, rather they reflect only orders of magnitudes relevant real-world 
systems. In that sense we consider here a qualitative model system, which 
allows us to illustrate the invariant grids method. Nevertheless, modeling of 
more realistic systems differs only in the number of species and equations. 
This leads, of course, to computationally harder problems, but difficulties are 
not crucial. 
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Figure 10.4a presents a one-dimensional invariant grid constructed for the 
system. Figure 10.4b demonstrates the reduced dynamics along the manifold 
(for the explanation of the meaning of the x-coordinate, see the previous 
subsection). In Fig. 10.4c the three smallest by the absolute value non-zero 
eigenvalues of the symmetrically linearized Jacobian matrix of the system are 
shown. One can see that the two smallest eigenvalues almost interchange on 
one of the grid ends. This means that the one-dimensional “slow” manifold 
faces definite problems in this region, it is just not well defined there. In 
practice, it means that one has to use at least a two-dimensional grids there. 

Figure 10.5a gives a view of the two-dimensional invariant grid, con¬ 
structed for the system, using the “invariant flag” strategy. The grid was 
raised starting from the lD-grid constructed at the previous step. At the 
first iteration for every node of the initial grid, two nodes (and two edges) 
were added. The direction of the step was chosen as the direction of the eigen¬ 
vector of the matrix A syrn (at the point of the node), corresponding to the 
second “slowest” direction. The value of the step was chosen to be e = 0.05 
in terms of entropic distance. After several Newton’s iterations done until 
convergence was reached, new nodes were added in the direction “ortogonal” 
to the lD-grid. This time it was done by linear extrapolation of the grid on 
the same step e = 0.05. Once some new nodes become one or several nega¬ 
tive coordinates (the grid reaches the boundaries) they were cut off. If a new 
node has only one edge, connecting it to the grid, it was excluded (since it 
was impossible to calculate 2D-tangent space for this node). The process was 
continued until the expansion was possible (the ultimate state is when every 
new node had to be cut off). 

The method for calculating tangent vectors for this regular rectangular 
2D-grid was chosen to be quite simple. The grid consists of rows , which are 
co-oriented by construction to the initial lD-grid, and columns that consist 
of the adjacent nodes in the neighboring rows. The direction of the columns 
corresponds to the second slowest direction along the grid. Then, every row 
and column is considered as a lD-grid, and the corresponding tangent vectors 
are calculated as it was described before: 

9row(Xk,i) — (*£fc,z +1 %k,i— 1 )/||^fc,i+l %k,i—l || 

for the internal nodes and 

9row(%k, l) — (Xk,l ,2)/ ||^/c,l || 5 9row (%k,rik ) 

= ( x k,n k ~ x k,n k — l)/\\ x k,n k ~ x k,n k — ill 

for the nodes which are close to the grid’s edges. Here Xk,i denotes the vector 
of the node in the kth row, ith column; n & is the number of nodes in the kth 
row. Second tangent vector g co i(xk,i) is calculated analogously. In practice, 
it proves convenient to orthogonalize g r0 w{xk,i) and g co i(xk,i )• 
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c) entropic coordinate along the grid 

Fig. 10.4. One-dimensional invariant grid for model hydrogen burning reaction, 
(a) Projection into the 3d-space of ch , co, coh concentrations, (b) Concentration 
values along the grid, (c) Three smallest by the absolute value non-zero eigenvalues 
of the symmetrically linearized system 
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Fig. 10.5. Two-dimensional invariant grid for the model hydrogen burning reac¬ 
tion. (a) Projection into the 3d-space of ch , co, coh concentrations, (b) Projection 
into the principal 3D-subspace. Trajectories of the system are shown coming out 
from every node. Bold line denotes the one-dimensional invariant grid, starting from 
which the 2D-grid was constructed 
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10.8 Invariant Grid as a Tool for Data Visualization 

Invariant grids provide a possibility of data visualization. In this section we 
demonstrate this possibility on the model hydrogen burning reaction. Since 
the phase space is four-dimensional, it is impossible to visualize the grid in one 
of the coordinate 3D-views, as it was done in the previous subsection. To fa¬ 
cilitate visualization one can utilize traditional methods of multi-dimensional 
data visualization. Here we make use of the principal components analysis 
(see, for example, [273]), which constructs a three-dimensional linear sub¬ 
space with maximal dispersion of the othogonally projected data (grid nodes 
in our case). In other words, the method of principal components constructs 
in a multi-dimensional space a three-dimensional box such that the grid can 
be placed maximally tightly inside the box (in the mean square distance 
meaning). After projection of the grid nodes into this space, we get more or 
less adequate representation of the two-dimensional grid embedded into the 
six-dimensional concentrations space (Fig. 10.5b). The disadvantage of the 
approach is that the axes now do not bear any explicit physical meaning, 
they are just some linear combinations of the concentrations. 

One attractive feature of two-dimensional grids is the possibility to use 
them as a screen, on which one can display different functions /(c) defined in 
the concentrations space. This technology was exploited widely in the non¬ 
linear data analysis by the elastic maps method [272]. The idea is to “unfold” 
the grid on a plane (to present it in the two-dimensional space, where the 
nodes form a regular lattice). In other words, we are going to work in the 
internal coordinates of the grid. In our case, the first internal coordinate (let’s 
call it si) corresponds to the direction, co-oriented with the one-dimensional 
invariant grid, the second one (let us call it 52 ) corresponds to the second slow 
direction. By the construction, the coordinate line 52 = 0 line corresponds to 
the one-dimensional invariant grid. Units of si and 52 is the entropic distance. 

Every grid node has two internal coordinates (si, S 2 ) and, simultaneously, 
corresponds to a vector in the concentration space. This allows us to map 
any function /(c) from the multi-dimensional concentration space to the two- 
dimensional space of the grid. This mapping is defined in a finite number of 
points (grid nodes), and can be interpolated (linearly, in the simplest case) 
between them. Using coloring and isolines one can visualize the values of the 
function in the neighborhood of the invariant manifold. This is meaningful, 
since, by the definition, the system spends most of the time in the vicinity 
of the invariant manifold, thus, one can visualize the behavior of the system. 
As a result of applying this technology, one obtains a set of color illustrations 
(a stack of information layers), put onto the grid as a map. This enables 
applying the whole family of the well developed methods of working with 
the stack of information layers, such as the geographical information systems 
(GIS) methods. 

Briefly, this technique of the visualization is a useful tool for understand¬ 
ing of dynamical systems. It allows to see simultaneously many different 
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a) Concentration H 2 b) Concentration O 



c) Concentration OH d) Concentration H 


Fig. 10.6. Two-dimensional invariant grid as a screen for visualizing different func¬ 
tions defined in the concentrations space. The coordinate axes are entropic distances 
(see the text for the explanations) along the first and the second slowest directions 
on the grid. The corresponding ID invariant grid is denoted by bold line, the equi¬ 
librium is denoted by square 


scenarios of the system behavior, together with different system’s character¬ 
istics. 

Let us use the invariant grids for the the model hydrogen burning system 
as a screen for visualisation. The simplest functions to visualize are the coor¬ 
dinates: Ci(c) = Ci. In Fig. 10.6 we displayed four colorings, corresponding to 
the four arbitrarily chosen concentrations functions (of H 2 , O, H and OH ; 
Fig. 10.6a-d). The qualitative conclusion that can be made from the graphs 
is that, for example, the concentration of H 2 practically does not change dur¬ 
ing the first fast motion (towards the lD-grid) and then, gradually changes 
to the equilibrium value (the H 2 coordinate is “slow”). The O coordinate is 
the opposite case, it is the “fast” coordinate which changes quickly (on the 
first stage of the motion) to the almost equilibrium value, and it almost does 
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not change after that. Basically, the slopes of the coordinate isolines give 
some impression of how “slow” a given concentration is Fig. 10.6c shows an 
interesting behavior of the OH concentration. Close to the ID grid it behaves 
like a “slow coordinate”, but there is a region on the map where it has a clear 
“fast” behavior (middle bottom of the graph). 

The next two functions which one could wish to visualize are the entropy 
S and the entropy production a(c) = —dG/dt(c) = hi(c*/c® q )c.j. They 
are shown on Fig. 10.7a,b. 



a) Entropy 


b) Entropy Production 
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c) A3 /\2 relation 


d) A 2 /A 1 relation 


Fig. 10.7. Two-dimensional invariant grid as a screen for visualizing different func¬ 
tions defined in the concentrations space. The coordinate axes are entropic distances 
(see the text for the explanations) along the first and the second slowest directions 
on the grid. The corresponding ID invariant grid is denoted by bold line, the equi¬ 
librium is denoted by square 
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Finally, we visualize the relation between the relaxation times of the fast 
motion towards the 2D-grid and the slow motion along it. This is given on 
the Fig. 10.7c. This picture allows to make a conclusion that two-dimensional 
consideration can be appropriate for the system (especially in the “high # 2 , 
high O” region), since the relaxation times “towards” and “along” the grid 
are well separated. One can compare this to the Fig. 10. 7d, where the relation 
between relaxation times towards and along the lD-grid is shown. 
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P. and T. Ehrenfest introdused in 1911 a model of dynamics with a coarse- 
graining of the original conservative system in order to introduce irreversibil¬ 
ity [15]. Ehrenfests considered a partition of the phase space into small cells, 
and they have suggested to combine the motions of the phase space ensemble 
due to the reversible dynamics with the coarse-graining (“shaking”) steps - 
averaging of the density of the ensemble over the phase cells. This general¬ 
izes to the following: alternations of the motion of the phase ensemble due 
to the microscopic equations with returns to the quasiequilibrium manifold 
while preserving the values of the macroscopic variables. We here develop a 
formalism of nonequilibrium thermodynamics based on this generalization. 
The Ehrenfests’ coarse-graining can be treated as a a result of interaction 
of the system with a generalized thermostat. There are many ways for in¬ 
troduction of thermostat in computational statistical physics [283], but the 
Ehrenfests’ approach remains the basic for understanding the irreversibility 
phenomenon. 


11.1 Ehrenfests’ Coarse-Graining Extended 

to a Formalism of Nonequilibrium Thermodynamics 

The idea of the Ehrenfests is the following: One partitions the phase space of 
the Hamiltonian system into cells. The density distribution of the ensemble 
over the phase space evolves in time according to the Liouville equation within 
the time segments nr < t < (n+l)r, where r is the fixed coarse-graining time 
step. Coarse-graining is executed at discrete times nr, densities are averaged 
over each cell. This alternation of the regular flow with the averaging describes 
the irreversible behavior of the system. 

The most general construction extending the Ehrenfests’ idea is given 
below. Let us stay with notation of Chap. 3, and let a submanifold F(W ) be 
defined in the phase space U. Furthermore, we assume a map (a projection) 
is defined, 77 : U —> W, with the properties: 

IJ o F = 1, J7(F(y)) = y . (11.1) 

In addition, one requires some mild properties of regularity, in particular, 
surjectivity of the differential, D X F[ : E —>• 7, in each point x G U. 


Alexander N. Gorban and Iliya V. Karlin: Invariant Manifolds for Physical and Chemical 
Kinetics , Lect. Notes Phys. 660, 299-323 (2005) 
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Let us fix the coarse-graining time r > 0, and consider the following 
problem: Find a vector field F in W, 

= m , (n.2) 

such that, for every y E IF, 

n(T r F(y)) = O r y , (11.3) 

where T r is the shift operator for the system (3.1), and 0 T is the (yet un¬ 
known!) shift operator for the system in question (11.2). 

Equation (11.3) means that one projects not the vector fields but segments 
of trajectories. The resulting vector field F{y ) is called the natural projection 
of the vector field J(x). 

Let us assume that there is a very stiff hierarchy of relaxation times in the 
system (3.1): The motions of the system tend very rapidly to a slow manifold, 
and next proceed slowly along it. Then there is a smallness parameter, the 
ratio of these times. Let us take F for the initial condition to the film equation 
(4.5). If the solution F t relaxes to the positively invariant manifold F^, then 
in the limit of a very stiff decomposition of motions, the natural projection 
of the vector field J{x) tends to the usual infinitesimal projection of the 
restriction of J on F as r —> oo: 

^ 00 ( 2 /) = D X H\ X =F 00 (y)J[F qq^Jj)) . ( 11 * 4 ) 

For stiff dynamic systems, the limit (11.4) is qualitatively almost obvious: 
After some relaxation time To (for t > To), the motion T r (x) is located in 
an e-neighborhood of F oc (W). Thus, for t To, the natural projection F 
(equations (11.2) and (11.3)) is defined by the vector field attached to F ^ 
with any predefined accuracy. Rigorous proofs of (11.4) requires existence and 
uniqueness theorems, as well as uniform continuous dependence of solutions 
on the initial conditions and right hand sides of equations. 

The method of natural projector is applied not only to dissipative systems 
but also (and even mostly) to conservative systems. One of the methods 
to study the natural projector is based on series expansion 1 in powers of 
t. Various other approximation schemes like the Pade approximation are 
possible too. 

The construction of the natural projector was rediscovered in a rather 
different context by Chorin, Hald and Kupferman [282]. They constructed 
the optimal prediction methods for an estimation of the solution of nonlin¬ 
ear time-dependent problems when that solution is too complex to be fully 

1 In the well-known work of Lewis [281], this expansion was executed incorrectly 
(terms of different orders were matched on the left and on the right hand sides 
of equation (11.3)). This created an obstacle in the development of the method. 
See a more detailed discussion in the example below. 
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resolved or when data are missing. The initial conditions for the unresolved 
components of the solution are drawn from a probability distribution, and 
their effect on a small set of variables that are actually computed is evaluated 
via statistical projection. The formalism resembles the projection methods of 
irreversible statistical mechanics, supplemented by the systematic use of con¬ 
ditional expectations and methods of solution for the fast dynamics equation, 
needed to evaluate a non-Markovian memory term. The authors claim [282] 
that result of the computations is close to the best possible estimate that can 
be obtained given the partial data. 

The majority of the methods of invariant manifold can be discussed as 
development of the Chapman-Enskog method. The central idea is to con¬ 
struct the manifold of distribution functions, where the slow dynamics occurs. 
The (implicit) change-over from solving the Boltzmann equation to construc¬ 
tion of invariant manifold was the crucial idea of Enskog and Chapman. On 
the other hand, the method of natural projector gives development to the 
ideas of the Hilbert method. The Hilbert method was historically the first 
in the solution of the Boltzmann equation. This method is not very popular 
nowdays, nevertheless, for some purposes it may be more convenient than 
the Chapman-Enskog method, for example, for a study of stationary solu¬ 
tions [284]. In the method of natural projector we are looking for solutions of 
kinetic equations with the quasiequilibrium initial state (and in the Hilbert 
method we start from the local equilibrium too). The main new element in 
the method of natural projector with respect to the Hilbert method is the 
construction of the macroscopic equation (11.3). In the next Example the 
solution for the matching condition (11.3) will be found in a form of Taylor 
series expansion. 

11.2 Example: From Reversible Dynamics 
to Navier—Stokes and Post-Navier—Stokes 
Hydrodynamics by Natural Projector 

The starting point of our construction are microscopic equations of motion. A 
traditional example of the microscopic description is the Liouville equation for 
classical particles. However, we need to stress that the distinction between 
“micro” and “macro” is always context dependent. For example, Vlasov’s 
equation describes the dynamics of the one-particle distribution function. In 
one statement of the problem, this is a microscopic dynamics in comparison 
to the evolution of hydrodynamic moments of the distribution function. In 
a different setting, this equation itself is a result of reducing the description 
from the microscopic Liouville equation. 

The problem of reducing the description includes a definition of the mi¬ 
croscopic dynamics, and of the macroscopic variables of interest, for which 
equations of the reduced description must be found. The next step is the con¬ 
struction of the initial approximation. This is the well known quasiequilibrium 
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approximation, which is the solution to the variational problem, S —> max, 
where S in the entropy, under given constraints. This solution assumes that 
the microscopic distribution functions depend on time only through their de¬ 
pendence on the macroscopic variables. Direct substitution of the quasiequi¬ 
librium distribution function into the microscopic equation of motion gives 
the initial approximation to the macroscopic dynamics. All further correc¬ 
tions can be obtained from a more precise approximation of the microscopic 
as well as of the macroscopic trajectories within a given time interval r which 
is the parameter of the method of natural projector. 

The method described here has several clear advantages: 

(i) It allows to derive complicated macroscopic equations, instead of writ¬ 
ing them ad hoc. This fact is especially significant for the description of 
complex fluids. The method gives explicit expressions for relevant variables 
with one unknown parameter (r). This parameter can be obtained from the 
experimental data. 

(ii) Another advantage of the method is its simplicity. For example, in the 
case where the microscopic dynamics is given by the Boltzmann equation, the 
approach avoids evaluation of the Boltzmann collision integral. 

(iii) The most significant advantage of this formalizm is that it is ap¬ 
plicable to nonlinear systems. Usually, in the classical approaches to reduced 
description, the microscopic equation of motion is linear. In that case, one 
can formally write the evolution operator in the exponential form. Obviously, 
this does not work for nonlinear systems, such as, for example, systems with 
mean field interactions. The method which we are presenting here is based on 
mapping the expanded microscopic trajectory into the consistently expanded 
macroscopic trajectory. This does not require linearity. Moreover, the order- 
by-order recurrent construction can be, in principle, enhanced by restoring 
to other types of approximations, like Pade approximation, for example, but 
we do not consider these options here. 

In the present section we discuss in detail applications of the method 
of natural projector [29,30,34] to derivations of macroscopic equations, and 
demonstrate how computations are performed in the higher orders of the 
expansion. The structure of the Example is as follows: In the next subsec¬ 
tion, we describe the formalization of Ehrenfests approach [29,30]. We stress 
the role of the quasiequilibrium approximation as the starting point for the 
constructions to follow. We derive explicit expressions for the correction to 
the quasiequilibrium dynamics, and conclude this section with the entropy 
production formula and its discussion. After that, we use the present formal¬ 
ism in order to derive hydrodynamic equations. Zeroth approximation of the 
scheme is the Euler equations of the compressible nonviscous fluid. The first 
approximation leads to the Navier-Stokes equations. Moreover, the approach 
allows to obtain the next correction, so-called post-Navier-Stokes equations. 
The latter example is of particular interest. Indeed, it is well known that the 
post-Navier-Stokes equations as derived from the Boltzmann kinetic equation 
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by the Chapman-Enskog method (the Burnett and the super-Burnett hydro¬ 
dynamics) suffer from unphysical instability already in the linear approxima¬ 
tion [72]. We demonstrate it by the explicit computation that the linearized 
higher-order hydrodynamic equations derived within the method of natural 
projector are free from this drawback. 


11.2.1 General Construction 


Let us consider a microscopic dynamics given by an equation, 

f = (H-5) 

where f(x,t) is a distribution function over the phase space x at time £, and 
where operator J(f) may be linear or nonlinear. We consider linear macro¬ 
scopic variables = //&(/), where operator /i/~ maps / into M&. The prob¬ 
lem is to obtain closed macroscopic equations of motion, M\ = </>&(M). This 
is achieved in two steps: First, we construct an initial approximation to the 
macroscopic dynamics and, second, this approximation is further corrected 
on the basis of the coarse-gaining. 

The initial approximation is the quasiequilibrium approximation, and it 
is based on the entropy maximum principle under fixed constraints (Chap. 5: 

S(f) —► max, n(f) = M , (11.6) 

where S is the entropy functional, which is assumed to be strictly concave, 
and M is the set of the macroscopic variables {M&}, and fi is the set of the 
corresponding operators. If the solution to the problem (11.6) exists, it is 
unique thanks to the concavity of the entropy functional. The solution to 
equation (11.6) is called the quasiequilibrium state, and it will be denoted 
as /*(M). The classical example is the local equilibrium of the ideal gas: / 
is the one-body distribution function, S is the Boltzmann entropy, /i are five 
linear operators, /i(f) = J{1, v, v 2 }f dv, with v the particle’s velocity; the 
corresponding f*(M) is called the local Maxwell distribution function. 

If the microscopic dynamics is given by equation (11.5), then the quasi- 
equilibrium dynamics of the variables M reads: 

Mk=l*k(J(r(M))=<l>k- (11-7) 


The quasiequilibrium approximation has important property, it conserves 
the type of the dynamics: If the entropy monotonically increases (or not de¬ 
creases) due to equation (11.5), then the same is true for the quasiequilibrium 
entropy, S*(M) = S(f*(M)), due to the quasiequilibrium dynamics (11.7). 
That is, if 


df 


dSjf) 

df 


J{f) > 0 , 


then 
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OC* _ OC* 

= £ m n{J(r{M))) - 0 - <1L8) 

k k 

Summation in k always implies summation or integration over the set of 
labels of the macroscopic variables. 

Conservation of the type of dynamics by the quasiequilibrium approxima¬ 
tion is a simple yet a general and useful fact. If the entropy S is an integral 
of motion of equation (11.5) then S*(M) is the integral of motion for the 
quasiequilibrium equation (11.7). Consequently, if we start with a system 
which conserves the entropy (for example, with the Liouville equation) then 
we end up with the quasiequilibrium system which conserves the quasiequi¬ 
librium entropy. For instance, if M is the one-body distribution function, and 
(11.5) is the (reversible) Liouville equation, then (11.7) is the Vlasov equation 
which is reversible, too. On the other hand, if the entropy was monotonically 
increasing on the solutions of equation (11.5), then the quasiequilibrium en¬ 
tropy also increases monotonically on the solutions of the quasiequilibrium 
dynamic equations (11.7). For instance, if equation (11.5) is the Boltzmann 
equation for the one-body distribution function, and M is a finite set of mo¬ 
ments (chosen in such a way that the solution to the problem (11.6) exists), 
then (11.7) are closed moment equations for M which increase the quasiequi¬ 
librium entropy (this is the essence of a well known generalization of Grad’s 
moment method, Chap. 5). 


11.2.2 Enhancement of Quasiequilibrium Approximations 
for Entropy-Conserving Dynamics 

The goal of the present subsection is to describe the simplest analytic imple¬ 
mentation, the microscopic motion with periodic coarse-graining. The notion 
of coarse-graining was introduced by P. and T. Ehrenfest in their seminal 
work [15]: The phase space is partitioned into cells, the coarse-grained vari¬ 
ables are the amounts of the phase density inside the cells. Dynamics is de¬ 
scribed by the two processes, by the Liouville equation for /, and by periodic 
coarse-graining, replacement of f{pc) in each cell by its average value in this 
cell. The coarse-graining operation means forgetting the microscopic details, 
or of the history. 

From the perspective of the general quasiequilibrium approximations, pe¬ 
riodic coarse-graining amounts to the return of the true microscopic trajec¬ 
tory on the quasiequilibrium manifold with the preservation of the macro¬ 
scopic variables. The motion starts at the quasiequilibrium state /*. Then 
the true solution fi(t) of the microscopic equation (11.5) with the initial con¬ 
dition fi(0 ) = /* is coarse-grained at a fixed time t = r, solution fi(r) is 
replaced by the quasiequilibrium function /* +1 = /*(/i(/i(r))). This process 
is sketched in Fig. 11.1. 

From the features of the quasiequilibrium approximation it follows that 
for the motion with the periodic coarse-graining, the inequality is valid, 
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Fig. 11.1. Coarse-graining scheme. / is the space of microscopic variables, M is 
the space of the macroscopic variables, /* is the quasiequilibrium manifold, /x is 
the mapping from the microscopic to the macroscopic space 


sun < suui) , (n.9) 

the equality occurs if and only if the quasiequilibrium is the invariant mani¬ 
fold of the dynamic system (11.5). Whenever the quasiequilibrium is not the 
solution to equation (11.5), the strict inequality in (11.9) demonstrates the 
entropy increase. Following Ehrenfests, the sequence of the quasiequilibrium 
states is called the H- curve. 

In other words, let us assume that the trajectory begins at the quasi¬ 
equilibrium manifold, then it takes off from this manifold according to the 
microscopic evolution equations. Then, after some time r, the trajectory is 
coarse-grained, that is the, state is brought back on the quasiequilibrium 
manifold while keeping the current values of the macroscopic variables. The 
irreversibility is born in the latter process, and this construction clearly rules 
out quasiequilibrium manifolds which are invariant with respect to the mi¬ 
croscopic dynamics, as candidates for a coarse-graining. 

The coarse-graining indicates the way to derive equations for the macro¬ 
scopic variables from the condition that the macroscopic trajectory, M(£), 
which governs the motion of the quasiequilibrium states, /*(M(t)), should 
match precisely the same points on the quasiequilibrium manifold, 
+ t)), and this matching should be independent of both the initial 
time, £, and the initial condition, M(t). The problem is then how to derive the 
continuous time macroscopic dynamics which would be consistent with this 
picture. The simplest realization suggested in [29, 30] is based on matching 
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an expansion of both the microscopic and the macroscopic trajectories. Here 
we present this construction to the third order accuracy [29,30]. 

Let us write down the solution to the microscopic equation (11.5), and ap¬ 
proximate this solution by the polynomial of the third order in r. Introducing 
notation, J* = J(/*(M(£))), we write, 


f(t + r) = r + Tj* + 


t 2 dJ* r 3 fdJ*dJ* 


. T* _|_ 

2 df 3! 


q2 t* 

J * + U7^ J * J * ) + 0 ( T ' 6 ) ■ 


df df" ' df 2 

( 11 . 10 ) 

Evaluation of the macroscopic variables on the function (11.10) gives 


M k (t + t ) 


t 2 fdJ* 

M k +rcfl + -^^ — r 


(11.11) 


r 

3! 


;h 


dJ* dJ* 


J* 


l^k 


d 2 J* 

~dp 


J*J*) | 


+ o(r 3 ) 


where fa = /i/c(J*) is the quasiequilibrium macroscopic vector field (the right 
hand side of equation (11.7)), and all the functions and derivatives are taken 
in the quasiequilibrium state at time t. 

We shall now establish the macroscopic dynamic by matching the macro¬ 
scopic and the microscopic dynamics. Specifically, the macroscopic dynamic 
equations (11.7) with the right-hand side not yet defined, give the following 
third-order result: 


M k (t + t) 


M k + T<f> k +— 

i 

7-3 \ ( d^(fk , 

3! ^ \dMiMj™ 


ddk 

dM j 


<Pj 


d(j>k dfu \ 
)j + dMidM^j 


( 11 . 12 ) 


o(r 3 ) . 


Expanding functions fa into a series 


4>k = R k ] + tR 


?(!) 


+ r 2 4 2) 


+ ■ 


( 4 0) 


<n, 


and requiring that the microscopic and the macroscopic dynamics coincide 
to the order of r 3 , we obtain the sequence of approximations to the right- 
hand side of the equation for the macroscopic variables. Zeroth order is the 
quasiequilibrium approximation to the macroscopic dynamics. The first-order 
correction gives: 


(i) _ 

k ~ 
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dfl 

dMj 



(11.13) 


The next, second-order correction has the following explicit form: 











11.2 Example: Post-Navier-Stokes Hydrodynamics 307 


M 2) = “T 


i{-( 
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3! ^ 


dJ* dJ* 
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d Mid Mi 
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fd 2 J* 
Mfc ^ df2 J 
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2 ^ 
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dM. 




dR[ 


ij 

(i) 


dMi 


dMi dMj 


(11.14) 


Further corrections are found by the same token. Equations (11.13)-(11.14) 
give explicit closed expressions for corrections to the quasiequilibrium dy¬ 
namics to the order of accuracy specified above. 


11.2.3 Entropy Production 


The most important consequence of the above construction is that the result¬ 
ing continuous time macroscopic equations retain the dissipation property of 
the discrete time coarse-graining (11.9) on each order of approximation n > 1. 
Let us first consider the entropy production formula for the first-order ap¬ 
proximation. In order to shorten notations, it is convenient to introduce the 
quasiequilibrium projection operator, 

(IMS) 

k 


It has been demonstrated in [30] that the entropy production, 


dS* 




equals 


£(*i ) = 


d 2 S * 
dfdf 


(1-P*)J* . 
f* 


(11.16) 


Expression (11.16) is nonnegative definite due to concavity of the entropy. 
The entropy production (11.16) is equal to zero only if the quasiequilibrium 
approximation is the true solution to the microscopic dynamics, that is, if 
(1 — P*) J* = 0. While quasiequilibrium approximations which solve the Li- 
ouville equation are uninteresting objects (except, of course, for the equilib¬ 
rium itself), vanishing of the entropy production in this case is a simple test 
of consistency of the theory. Note that the entropy production (11.16) is pro¬ 
portional to r. Note also that the projection operator does not appear in our 
consideration a priory, rather, it is the result of exploring the coarse-graining 
condition in the previous subsection. 

Though equation (11.16) looks very natural, its existence is rather subtle. 
Indeed, equation (11.16) is a difference of the two terms, ^ k dJ*/df) 
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(contribution of the second-order approximation to the microscopic trajec¬ 
tory), and Z^dR^/dM, (contribution of the derivative of the quasi¬ 
equilibrium vector field). Each of these expressions separately gives a positive 
contribution to the entropy production, and equation (11.16) is the difference 
of the two positive definite expressions. In the higher order approximations, 
these subtractions are more involved, and explicit demonstration of the en¬ 
tropy production formulae becomes a formidable task. Yet, it is possible to 
demonstrate the increase-in-entropy without explicit computation, though at 
a price of smallness of r. Indeed, let us denote the time derivative of the 
entropy on the nth order approximation. Then 

rt+r 

Jf S\ n) {s) &s = S*(t + t) - S*(t) + 0(r n+1 ) , 

where S*(t+r) and S*(t) are true values of the entropy at the adjacent states 
of the 17-curve. The difference SS = S*(t + r) — S*(t) is strictly positive for 
any fixed r, and, by equation (11.16), SS ~ r 2 for small r. Therefore, if r is 
small enough, the right hand side in the above expression is positive, and 

rS* {n) (e {n) ) > 0 , 

where t < 0( n ) < t + r. Finally, since S^Jt) = S* n ^ (s) + 0(r n ) for any s on 
the segment [t, t + r], we can replace S( n \(0( n )) in the latter inequality by 
S( n ^(t). The sense of this consideration is as follows: Since the entropy pro¬ 
duction formula (11.16) is valid in the leading order of the construction, the 
entropy production will not collapse in the higher orders at least if the coarse- 
graining time is small enough. More refined estimations can be obtained only 
from the explicit analysis of the higher-order corrections. 


11.2.4 Relation to the Work of Lewis 


Among various realizations of the coarse-graining procedures, the work of 
Lewis [281] appears to be most close to our approach. It is therefore pertinent 
to discuss the differences. Both methods are based on the coarse-graining 
condition, 

M k (t + r) = ( T T f*(M(t ))) , (11.17) 

where T r is the formal solution operator of the microscopic dynamics. Above, 
we applied a consistent expansion of both, the left hand side and the right 
hand side of the coarse-graining condition (11.17), in terms of the coarse- 
graining time r. In the work of Lewis [281], it was suggested, as a general 
way to exploring the condition (11.17), to write the first-order equation for 
M in the form of the differential pursuit, 


M k (t) +T 


d Mfe(i) 


» k (T T r(M(t))) . 


(11.18) 


d t 
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In other words, in the work of Lewis [281], the expansion to the first order 
was considered on the left (macroscopic) side of equation (11.17), whereas the 
right hand side containing the microscopic trajectory T r /*(M(£)) was not 
treated on the same footing. Clearly, expansion of the right hand side to first 
order in r is the only equation which is common in both approaches, and this 
is the quasiequilibrium dynamics. However, the difference occurs already in 
the next, second-order term (see [29,30] for details). Namely, the expansion to 
the second order of the right hand side of Lewis’ equation (11.18) results in a 
dissipative equation (in the case of the Liouville equation, for example) which 
remains dissipative even if the quasiequilibrium approximation is the exact 
solution to the microscopic dynamics, that is, when microscopic trajectories 
once started on the quasiequilibrium manifold belong to it in all the later 
times, and thus no dissipation can be born by any coarse-graining. 

On the other hand, our approach assumes a certain smoothness of tra¬ 
jectories so that the application of the low-order expansion bears physical 
significance. For example, while using lower-order truncations it is not pos¬ 
sible to derive the Boltzmann equation because in that case the relevant 
quasiequilibrium manifold (7V-body distribution function is proportional to 
the product of one-body distributions, or uncorrelated states) is almost in¬ 
variant during the long time (of the order of the mean free flight of particles), 
while the trajectory steeply leaves this manifold during the short-time pair 
collision. It is clear that in such a case lower-order expansions of the mi¬ 
croscopic trajectory do not lead to useful results. It has been clearly stated 
by Lewis [281], that the exploration of the condition (11.17) depends on the 
physical situation, and how one makes approximations. In fact, derivation of 
the Boltzmann equation given by Lewis on the basis of the condition (11.17) 
does not follow the differential pursuit approximation: As is well known, the 
expansion in terms of particle’s density of the solution to the BBGKY hi¬ 
erarchy is singular, and begins with the linear in time term. Assuming the 
quasiequilibrium approximation for the 7V-body distribution function under 
fixed one-body distribution function, and that collisions are well localized in 
space and time, one gets on the right hand side of equation (11.17), 

f(t + t) = f(t) + nr+ o(n) , 

where n is particle’s density, / is the one-particle distribution function, and 
Jb is the Boltzmanns collision integral. Next, using the mean-value theorem 
on the left hand side of the equation (11.17), the Boltzmann equation is 
derived (see also a recent elegant renormalization-group argument for this 
derivation [55]). 

Our approach of matched expansions for exploring the coarse-graining 
condition (11.17) is, in fact, the exact (formal) statement that the unknown 
macroscopic dynamics which causes the shift of M\ on the left hand side 
of equation (11.17) can be reconstructed order-by-order to any degree of 
accuracy, whereas the low-order truncations may be useful for certain physical 
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situations. A thorough study of the cases beyond the lower-order truncations 
is of great importance which is left for Chap. 12. 

11.2.5 Equations of Hydrodynamics 

The method discussed above enables one to establish in a simple way the 
form of equations of the macroscopic dynamics to various degrees of approx¬ 
imation. 

In this subsection, the microscopic dynamics is given by the simplest one- 
particle Liouville equation (the equation of free flight). For the macroscopic 
variables we take the density, average velocity, and temperature (average 
kinetic energy) of the fluid. Under this condition the solution to the quasi¬ 
equilibrium problem (11.6) is the local Maxwell distribution. For the hydro- 
dynamic equations, the zeroth (quasiequilibrium) approximation is given by 
Euler’s equations of compressible nonviscous fluid. The next order approxi¬ 
mation are the Navier-Stokes equations which have dissipative terms. 

Higher-order approximations to the hydrodynamic equations, when they 
are derived from the Boltzmann kinetic equation (the so-called Burnett ap¬ 
proximation), are subject to various difficulties, in particular, they exhibit an 
instability of acoustic waves at sufficiently short wave length (see, e.g. [42] for 
a recent review). Here we demonstrate how model hydrodynamic equations, 
including the post-Navier-Stokes approximations, can be derived on the ba¬ 
sis of the coarse-graining idea, and study the linear stability of the obtained 
equations. We found that the resulting equations are stable. 

Two points need a clarification before we proceed further [30]. First, be¬ 
low we consider the simplest Liouville equation for the one-particle distribu¬ 
tion, describing freely moving particles without interactions. The procedure 
of coarse-graining we use is an implementation of collisions leading to dis¬ 
sipation. If we had used the full interacting 7V-particle Liouville equation, 
the result would be different, in the first place, in the expression for the lo¬ 
cal equilibrium pressure. Whereas in the present case we have the ideal gas 
pressure, in the Wparticle case the non-ideal gas pressure would arise. 

Second, and more essential is that, to the order of the Navier-Stokes 
equations, the result of our method is identical to the lowest-order Chapman- 
Enskog method as applied to the Boltzmann equation with a single relaxation 
time model collision integral (the Bhatnagar-Gross-Krook model [116]). 
However, this happens only at this particular order of approximation, be¬ 
cause already the next, post-Navier-Stokes approximation, is different from 
the Burnett hydrodynamics as derived from the BGK model (the latter is 
unstable). 

11.2.6 Derivation of the Navier-Stokes Equations 

Let us assume that reversible microscopic dynamics is given by the one- 
particle Liouville equation, 
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dj_ 

dt 



(11.19) 


where / = /(r,v,t) is the one-particle distribution function, and index i 
runs over spatial components {x, y, z}. Subject to appropriate boundary 
conditions which we assume, this equation conserves the Boltzmann entropy 
S= -k B f flnfdvdr. 

We introduce the following hydrodynamic moments as the macroscopic 
variables: Mo = f fdv, Mi = f Vifdv , M 4 = f v 2 fdv. These variables are 
related to the more conventional density, average velocity and temperature, 
n, n, T as follows: 


-j. _. „ .. , _. 3nkBT 2 

M 0 = n , Mi = mq , M 4 =-1- mr , 

m 

n = M 0 , Ui = M^ 1 M i , T=^ m -(M 4 -Mo 1 M 1 M 1 ). (11.20) 
The quasiequilibrium distribution function (local Maxwellian) reads: 


fo = n 


m 

27t&bT 


3/2 

exp 


f —m(v — u ) 2 ^ 

V 2feT ; ' 


( 11 . 21 ) 


Here and below, n, u, and T depend on r and t. 

Based on the microscopic dynamics (11.19), the set of macroscopic vari¬ 
ables (11.20), and the quasiequilibrium (11.21), we can derive the equations 
of the macroscopic motion. 

A specific feature of the present example is that the quasiequilibrium 
equation for the density (the continuity equation), 


dn dnui 

dt dri 


( 11 . 22 ) 


should be excluded out of the further corrections. This rule should be applied 
generally: If a part of the chosen macroscopic variables (momentum flux nu 
here) correspond to fluxes of other macroscopic variables, then the quasiequi- 
librium equation for the latter is already exact, and has to be exempted of 
corrections. 

The quasiequilibrium approximation for the rest of the macroscopic vari¬ 
ables is derived in the usual way. In order to derive the equation for the 
velocity, we substitute the local Maxwellian into the one-particle Liouville 
equation, and act with the operator /q~ = f Vk - dv on both the sides of the 
equation (11.19). We have: 


dnuk d nk^T dnukUj 

dt drk m drj 


Similarly, we derive the equation for the energy density, and the complete 
system of equations of the quasiequilibrium approximation reads (compress¬ 
ible Euler equations): 
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dn 

dt 

dnuk 

dt 

de 

dt 


dnui 

dri 

d nk^T dnukUj 

drk m drj 


d 

dri 



nui + u nui 


(11.23) 


where varepsilon = ^nk^T is the energy density. 

Now we are going to derive the next order approximation to the macro¬ 
scopic dynamics (first order in the coarse-graining time r). For the velocity 
equation we have: 
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nu k 
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where <j)j are the corresponding right hand sides of the Euler equations 
(11.23). In order to take derivatives with respect to macroscopic moments 
{M 0 ,M*,M 4 }, we need to rewrite equations (11.23) in terms of these vari¬ 
ables instead of {n, iq,T}. After some computation, we obtain: 
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(11.24) 


(11.25) 


Thus, we get the system of the Navier-Stokes equations in the following 
form: 
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We see that the kinetic coefficients (viscosity and heat conductivity) are pro¬ 
portional to the coarse-graining time r. Note that they are identical with 
kinetic coefficients as derived from the Bhatnagar-Gross-Krook model [116] 
in the first approximation of the Chapman-Enskog method [70]. 
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11.2.7 Post-Navier—Stokes Equations 


Now we are going to obtain the second-order approximation to the hydrody¬ 
namic equations in the framework of the present approach. We shall compare 
qualitatively the result with the Burnett approximation. The comparison 
concerns stability of the hydrodynamic modes near the global equilibrium. 
Stability of the global equilibrium is violated in the Burnett approximation. 
Though the derivation is straightforward also in the general, nonlinear case, 
we shall consider only the linearized equations which is appropriate to our 
purpose here. 

Linearizing the local Maxwell distribution function, we obtain: 


f rn \ 3 ' 2 
n ° \ 2nk r> T 0 ) 

■|(Afo + 2 MiCi + 


f n ( mv n t ( mv 2 3^ 
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(11.27) 


where we have introduced dimensionless variables: 


Vi ^ Sn Sui 3 Sn ST 

Ci — -5 M 0 — -, Mi — —, M 4 — --h — 

v T no v T 2 no T 0 


vt = ^/2k^To/m is the thermal velocity, Note that Sn, and ST determine 
deviations of these variables from their equilibrium values, no, and Tq. 

The linearized Navier-Stokes equations read: 

dM 0 _ dMi 
dt dri 

dM}, 1 d M 4 rdf dM^ dMj 

dt 3 drk + 4 drj \ drj + drk 

dM A _ 5 dMi 5 <9 2 M 4 

dt 2 dri + T 2 dridri 

Let us first compute the post-Navier-Stokes correction to the velocity 
equation. In accordance with the equation (11.14), the first part of this term 
in the linear approximation is: 
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(11.28) 


(11.29) 
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The part of equation (11.14) proportional to the first-order correction is: 


1 y (m od) | A _ 5 d d 2 M 4 i d d 2 M 4 

2 ydMj J dMj j J 6 drk dr s dr s 9 drk dr s dr s 

Combining together terms (11.29), and (11.30), we obtain: 


(11.30) 


(2 ) _ 1 d <9 2 Mo 89 d d 2 M 4 

Mfc 8 dr s dr s ”^108 drk dr s dr s 
Similar calculation for the energy equation leads to the following result: 
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The term proportional to the first-order corrections gives: 

5 7 d 2 dMA 25 / ^ dMA 
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Thus, we obtain: 

o(2) = 59 f a 2 dMA 
M4 9 \dr s dr s dr, J 


(11.31) 


Finally, combining together all the terms, we obtain the following system 
of linearized hydrodynamic equations: 
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(11.32) 


Now we are in a position to investigate the dispersion relation of this 
system. Substituting Mi = Mi exp(o;t + i(fe,r)) (i = 0, &, 4) into equation 
(11.32), we reduce the problem to finding the spectrum of the matrix: 
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Fig. 11.2. Attenuation rates of various modes of the post-Navier-Stokes equations 
as functions of the wave vector. Attenuation rate of the twice degenerated shear 
mode is curve 1. Attenuation rate of the two sound modes is curve 2. Attenuation 
rate of the diffusion mode is curve 3 
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This matrix has five eigenvalues. The real parts of these eigenvalues re¬ 
sponsible for the decay rate of the corresponding modes are shown in Fig. 11.2 
as functions of the wave vector k. We see that all real parts of all the eigenval¬ 
ues are non-positive for any wave vector. In other words, this means that the 
present system is linearly stable. For the Burnett hydrodynamics as derived 
from the Boltzmann or from the single relaxation time Bhatnagar-Gross- 
Krook model, it is well known that the decay rate of the acoustic branch be¬ 
comes positive after some value of the wave vector [42,72], which leads to the 
instability. While the method suggested here is clearly semi-phenomenological 
(coarse-graining time r remains unspecified), the consistency of the expansion 
with the entropy requirements, and especially the latter result of the linear 
stable limit of the post-Navier-Stokes correction strongly indicates that it 
might be more suited to establishing models of highly nonequilibrium hydro¬ 
dynamics. 
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11.3 Example: Natural Projector 
for the Me Kean Model 

In this section the fluctuation-dissipation formula derived by the method of 
natural projector [31] is illustrated by the explicit computation for McKean’s 
kinetic model [285]. It is demonstrated that the result is identical, on the 
one hand, to the sum of the Chapman-Enskog expansion, and, on the other 
hand, to the solution of the invariance equation. The equality between all the 
three results holds up to the crossover from the hydrodynamic to the kinetic 
domain. 


11.3.1 General Scheme 

Let us consider a microscopic dynamics (3.1) given by an equation for the 
distribution function /(x,t) over a configuration space x : 

d t f = J(f ) , (11.33) 

where operator J(/ ) may be linear or nonlinear. Let m(/) be a set of linear 
functionals whose values, M = ra(/), represent the macroscopic variables, 
and also let be a set of distribution functions satisfying the consis¬ 

tency condition, 

m(/(M)) = M . (11.34) 

The choice of the relevant distribution functions is the point of central impor¬ 
tance which we discuss later on but for the time being we need the condition 
(11.34) only. 

Given a finite time interval r, it is possible to reconstruct uniquely the 
macroscopic dynamics from a single condition of the coarse-graning. For the 
sake of completeness, we shall formulate this condition here. Let us denote 
as M(t) the initial condition at the time t to the yet unknown equations of 
the macroscopic motion, and let us take f(M(t),x) for the initial condition 
of the microscopic equation (11.33) at the time t. Then the condition for the 
reconstruction of the macroscopic dynamics reads as follows: For every initial 
condition {7VT(t),t}, solution to the macroscopic dynamic equations at the 
time t + r is equal to the value of the macroscopic variables on the solution 
to equation (11.33) with the initial condition {/(ilT(t), x), £}: 

M(t + r) = m (T r /(M(t))) , (11.35) 

where T r is the formal solution operator of the microscopic equation (11.33). 
The right hand side of equation (11.35) represents an operation on trajecto¬ 
ries of the microscopic equation (11.33), introduced in a particular form by 
Ehrenfests’ [15] (the coarse-graining): The solution at the time t + r is re¬ 
placed by the state on the manifold /(AT, x). Notice that the coarse-graining 
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time r in equation (11.35) is finite, and we stress the importance of the re¬ 
quired independence from the initial time £, and from the initial condition 
at t. 

The essence of the reconstruction of the macroscopic equations from the 
condition just formulated is in the following [29,30]: Seeking the macroscopic 
equations in the form, 

d t M = B(M,r) , (11.36) 

we proceed with the Taylor expansion of the unknown functions R in terms 
of powers r n , where n = 0,1,..., and require that each approximation, R^ n \ 
of the order n, is such that the resulting macroscopic solutions satisfy the 
condition (11.36) to the order r n+1 . This process of successive approxima¬ 
tion is solvable. Thus, the unknown macroscopic equation (11.36) can be 
reconstructed to any given accuracy. 

Coming back to the problem of choosing the distribution function 
/(AT,x), we recall that many physically relevant cases of the microscopic 
dynamics (11.33) are characterized by existence of a concave functional S(f) 
(the entropy functional; discussions of S can be found in [115,191,192]). Tra¬ 
ditionally, two cases are distinguished, the conservative [dS/dt = 0 due to 
equation (11.33)], and the dissipative [dS/dt > 0 due to equation (11.33), 
where equality sign corresponds to the stationary solution]. The approach 
(11.35) and (11.36) is applicable to both these situations. In both of these 
cases, among the possible sets of distribution functions the distin¬ 

guished role is played by the well known quasiequilibrium approximations, 
f*(M,x), which are maximizers of the functional S(f) for fixed M . We re¬ 
call that, due to convexity of the functional S', if such maximizer exists then 
it is unique. 

The special role of the quasiequilibrium approximations is due to the 
fact that they preserve the type of dynamics (Chap. 5): If dS/dt > 0 due 
to equation (11.33), then dS*/dt > 0 due to the quasiequilibrium dynam¬ 
ics, where S*(M) = S(f*(M)) is the quasiequilibrium entropy, and where 
the quasiequilibrium dynamics coincides with the zeroth order in the above 
construction, R ^ 

In particular, the strict increase in the quasiequilibrium entropy has been 
demonstrated for the first and higher order approximations (see preceding 
sections of this chapter and [30]). Examples have been provided focusing on 
the conservative case, and demonstrating that several well known dissipative 
macroscopic equations, such as the Navier-Stokes equation and the diffusion 
equation for the one-body distribution function, are derived as the lowest 
order approximations of this construction. 

The advantage of the method of natural projector is the locality of con¬ 
struction, because only Taylor series expansion of the microscopic solution 
is involved. This is also its natural limitation. From the physical standpoint, 
finite and fixed coarse-graining time r remains a phenomenological device 
which makes it possible to infer the form of the macroscopic equations by a 
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non-complicated computation rather than to derive a full form thereof. For 
instance, the form of the Navier-Stokes equations can be derived from the 
simplest model of free motion of particles, in which case the coarse-graining 
is a substitution for collisions (see previous example. 

Going away from the limitations imposed by the finite coarse graining time 
[29,30] can be recognized as the major problem of a consistent formulation 
of the nonequilibrium statistical thermodynamics. Intuitively, this requires 
taking the limit r —> oo, allowing for all the relevant correlations to be 
developed by the microscopic dynamics, rather than to be cut off at the 
finite r (see Chap. 12). 

11.3.2 Natural Projector for Linear Systems 

However, there is one important exception when the “r —> oc problem” is 
readily solved [30,31]. This is the case where equation (11.33) is linear, 

dtf = Lf , (11.37) 

and where the quasiequilibrium is a linear function of M. This is, in particu¬ 
lar, the classical case of the linear irreversible thermodynamics where one con¬ 
siders the linear macroscopic dynamics near the equilibrium, / eq , Lf eq = 0. 
We assume, for simplicity, that the macroscopic variables M are equal to zero 
at the equilibrium, and are normalized in such a way that m(/ eq m t) = 1, 
where t denotes transposition, and 1 is an appropriate identity operator. In 
this case, the linear dynamics of the macroscopic variables M has the form, 

d t M = RM , (11.38) 

where the linear operator R is determined by the coarse-graining condition 
(11.35) in the limit r —> oo: 


R = lim — In \m (e rL / eq m^)l . (11.39) 

Formula (11.39) has been already briefly mentioned in [30], and its relation 
to the Green-Kubo formula has been demonstrated in [31]. The Green-Kubo 
formula reads: 

rOO 

Rgk= / (rh(O)m(t)) dt , (11.40) 

Jo 

where angular brackets denote equilibrium averaging, and where rin = L^m. 
The difference between the formulae (11.39) and (11.40) stems from the fact 
that condition (11.35) does not use an a priori hypothesis about the sepa¬ 
ration of the macroscopic and the microscopic time scales. For the classical 
7V-particle dynamics, equation (11.39) is a very complicated expression, in¬ 
volving a logarithm of non-commuting operators. It is therefore desirable to 
gain its understanding in simple model situations. 
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11.3.3 Explicit Example of the Fluctuation—Dissipation Formula 

In this subsection we want to give an explicit example of the formula (11.39). 
In order to make our point, we consider here dissipative rather than conser¬ 
vative dynamics in the framework of the well known toy kinetic model in¬ 
troduced by McKean [285] for the purpose of testing various ideas in kinetic 
theory. In the dissipative case with a clear separation of time scales, existence 
of the formula (11.39) is underpinned by the entropy growth in both the fast 
and slow dynamics. This physical idea underlies generically the extraction 
of the slow (hydrodynamic) component of motion through the concept of 
normal solutions to kinetic equations, as pioneered by Hilbert [16], and has 
been discussed by many authors, e.g. . [112,197,201]. Case studies for linear 
kinetic equation help clarifying the concept of this extraction [202,203,285]. 

Therefore, since for the dissipative case there exist well established ap¬ 
proaches to the problem of reducing the description, and which are exact 
in the present setting, it is very instructive to see their relation to the for¬ 
mula (11.39). Specifically, we compare the result with the exact sum of the 
Chapman-Enskog expansion [70], and with the exact solution in the frame¬ 
work of the method of invariant manifold. We demonstrate that both the 
three approaches, different in their nature, give the same result as long as 
the hydrodynamic and the kinetic regimes are separated. 

The McKean model is the kinetic equation for the two-component vector 
function f(r,t) = (f+(r,t), f-(r,t)) f : 

dtf+ = -drU + e -1 - /+) , (11.41) 

dtf- = d r f. + e - 1 (E±E _ . 

Equation (11.41) describes the one-dimensional kinetics of particles with ve¬ 
locities + 1 and —1 as a combination of the free flight and a relaxation with 
the rate e -1 to the local equilibrium. Using the notation, (x,y), for the 
standard scalar product of the two-dimensional vectors, we introduce the 
fields, n(r,t) = (n, /) [the local particle’s density, where n = (1,1)], and 
j(r,t) = (j,/) [the local momentum density, where j = (1,-1)]. Equation 
(11.41) can be equivalently written in terms of the moments, 

d t n = -d r j , (11.42) 

dtj = -d r n - e~ 1 j . 

The local equilibrium, 

/» = !", (11-43) 

is the conditional maximum of the entropy, 

S=- j (/+ In /+ + /_ In /-) dr , 
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under the constraint which fixes the density, (n,/*) = n. The quasiequilib¬ 
rium manifold (11.43) is linear in our example, as well as the kinetic equation. 

The problem of reducing the description for the model (11.41) amounts 
to finding the closed equation for the density field n(r, t). When the relax¬ 
ation parameter e -1 is small enough (the relaxation dominance), then the 
first Chapman-Enskog approximation to the momentum variable, j(r,t) ~ 
—e<9 r n(r, £), amounts to the standard diffusion approximation. Let us consider 
now how the formula (11.39), and other methods, extend this result. 

Because of the linearity of the equation (11.41) and of the local equi¬ 
librium, it is natural to use the Fourier transform, hk = J exp(ikr)h(r) dr. 
Equation (11.41) is then written, 


dtfk = L kf k , 


(11.44) 


where 



(11.45) 


Derivation of the fluctuation-dissipation formula (11.39) in our example goes 
as follows: We seek the macroscopic dynamics of the form, 


dt'H'k — Rk^k 5 


(11.46) 


where the function R is yet unknown. In the left-hand side of equation 
(11.35) we have: 

n k (t + t) = e TRk n k (t ) . (11.47) 

In the right-hand side of equation (11.35) we have: 


^n, e r ^ k 


r 




(11.48) 


After equating the expressions (11.47) and (11.48), we require that the re¬ 
sulting equality holds in the limit r —> oo independently of the initial data 
rik(t). Thus, we arrive at the formula (11.39): 


Rk 


lim — In 

r—> oo T 



(11.49) 


Equation (11.49) defines the macroscopic dynamics (11.46) within the present 
approach. Explicit evaluation of the expression (11.49) is straightforward in 
the present model. Indeed, operator L *. has two eigenvalues, where 


A i = ~i ± (“ 50 > 

Let us denote as e ^ two (arbitrary) eigenvectors of the matrix L*., corre¬ 
sponding to the eigenvalues A±. Vector n has a representation, n = ot^e^ + 
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a k e k , where a± are complex-valued coefficients. With this, we obtain in 
equation (11.49), 


Rk = lim — In 

T—>OO T 


_ (n,e+)e Tyl fc + a k (n, e k )e TA * 


For k < fc c , where k 2 = 4e, we have > A fc . Therefore, 

i4 = A k , for k < k c . 


(11.51) 


(11.52) 


As was expected, formula (11.39) in our case results in the exact hydrody¬ 
namic branch of the spectrum of the kinetic equation (11.41). The standard 
diffusion approximation is recovered from equation (11.52) as the first non¬ 
vanishing approximation in terms of the (k/k c ) 2 . 

At k = fc c , the crossover from the extended hydrodynamic to the kinetic 
regime takes place, and ReA^ = ReA k . However, we may still extend the 
function R for k > k c on the basis of the formula (11.49): 

R k = Re A+ for k > k c (11.53) 


Notice that the function Rk as given by equations (11.52) and (11.53) is 
continuous but non-analytic at the crossover. 


11.3.4 Comparison with the Chapman—Enskog Method 
and Solution of the Invariance Equation 

Let us now compare this result with the Chapman-Enskog method. Since the 
exact Chapman-Enskog solution for the systems like equation (11.43) has 
been recently discussed in detail elsewhere [40,42,205,219-221], we shall be 
brief here. Following the Chapman-Enskog method, we seek the momentum 
variable j in terms of an expansion, 


j CE = ^ e n+1 j(”) (11.54) 

n=0 

The Chapman-Enskog coefficients, j^ n \ are found from the recurrence equa¬ 
tions, 

j(n) = _ ^ d (m) j{ n- 1-m) ; (H.55) 

m =0 

where the Chapman-Enskog operators d[ m ^ are defined by their action on 
the density n : 

d[ m) n = -a r j (m) . (11.56) 

The recurrence equations (11.54), (11.55), and (11.56), become well defined 
as soon as the aforementioned zero-order approximation j is specified, 
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j(°) = -d r n . (11.57) 

From equations (11.55), (11.56), and (11.57), it follows that the Chapman- 
Enskog coefficients j^ have the following structure: 

j (n) = b n d 2 r n+1 n , (11.58) 


where coefficients b n are found from the recurrence equation, 

n —1 

b n - ^ ^ 5 n _i_ m 6 m , bo = 1 . (11.59) 

m =o 

Notice that coefficients (11.59) are real-valued, by the sense of the Chapman- 
Enskog procedure. The Fourier image of the Chapman-Enskog solution for 
the momentum variable has the form, 

Jk E = ikB^n k , (11.60) 

where 

oo 

B% E = J2bn(-ek 2 ) n . (11.61) 

n=0 

Equation for the function B (11.61) is easily found upon multiplying equation 
(11.59) by (—& 2 ) n , and summing in n from zero to infinity: 

ek 2 B 2 k + B k Tl = 0. (11.62) 


Solution to the latter equation which respects condition (11.57), and which 
constitutes the exact Chapman-Enskog solution (11.61) is: 


^ce f ^ Tlfc" 5 k < k c 

k | none, k > k c 


(11.63) 


Thus, the exact Chapman-Enskog solution derives the macroscopic equation 
for the density as follows: 


where 


d t n k = —ikj k E = 

r% e = I a ^ 

K I none, 


Rk E n k , 

(11.64) 

IV A 

o o 

(11.65) 


The Chapman-Enskog solution does not extend beyond the crossover at k c . 
This happens because the full Chapman-Enskog solution appears as a con¬ 
tinuation the diffusion approximation, whereas formula (11.49) is not based 
on such an extension. 

Finally, let us discuss briefly the comparison with the solution within the 
method of invariant manifold [9,11,14]. Specifically, the momentum variable 
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j^ nv = ikB^rik is required to be invariant of both the microscopic and 
the macroscopic dynamics, that is, the time derivative of j^ nv due to the 
macroscopic subsystem, 



( 11 . 66 ) 


should be equal to the derivative of j^ nv due to the microscopic subsystem, 


dtj'k v = ~ikn k - e 1 ikB™n k 


(11.67) 


and that the equality of the derivatives (11.66) and (11.67) should hold inde¬ 
pendently of the specific value of the macroscopic variable This amounts 
to a condition for the unknown function £>^ nv , which is essentially the same 
as equation (11.62), and it is straightforward to show that the same selection 
procedure of the hydrodynamic root as above in the Chapman-Enskog case 
results in equation (11.65). 

In conclusion, in this Example we have given the explicit illustration 
for the formula (11.39). The example demonstrates that the fluctuation- 
dissipation formula (11.39) gives the exact macroscopic evolution equation, 
which is identical to the sum of the Chapman-Enskog expansion, as well as 
to the invariance principle. This identity holds up to the point where the hy¬ 
drodynamics and the kinetics cease to be separated. Whereas the Chapman- 
Enskog solution does not extend beyond the crossover point, the formula 
(11.39) demonstrates a non-analytic extension. 



12 Geometry of Irreversibility: 

The Film of Nonequilibrium States 


A geometrical framework of nonequilibrium thermodynamics is developed in 
this chapter. The notion of macroscopically definable ensembles is introduced. 
A thesis about macroscopically definable ensembles is suggested. This the¬ 
sis should play the same role in the nonequilibrium thermodynamics, as the 
well-known Church-Turing thesis in the theory of computability. The prim¬ 
itive macroscopically definable ensembles are described. These are ensem¬ 
bles with macroscopically prepared initial states. A method for computing 
trajectories of primitive macroscopically definable nonequilibrium ensembles 
is elaborated. These trajectories are represented as sequences of deformed 
quasiequilibrium ensembles and simple quadratic models between them. The 
primitive macroscopically definable ensembles form a manifold in the space of 
ensembles. We call this manifold the film of nonequilibrium states. The equa¬ 
tion for the film and the equation for the ensemble motion on the film are 
written down. The notion of the invariant film of non-equilibrium states, and 
the method of its approximate construction transform the problem of non- 
equilibrium kinetics into a series of problems of equilibrium statistical physics. 
The developed methods allow us to solve the problem of macro-kinetics even 
when there are no autonomous equations of macro-kinetics. 


12.1 The Thesis About Macroscopically Definable 
Ensembles 

and the Hypothesis About 

Primitive Macroscopically Definable Ensembles 

The goal of this chapter is to discuss the nonlinear problem of irreversibil¬ 
ity, and to revise previous attempts to solve it. The interest to the problem 
of irreversibility persists during decades. It has been intensively discussed 
in the past, and nice accounts of these discussions can be found in the lit¬ 
erature (see, for example, [194,195,286,287]). We here intend to develop a 
more geometrical viewpoint on the subject. First, in Sect. 12.2, we discuss 
in an informal way the origin of the problem, and demonstrate how the ba¬ 
sic constructions arise. Second, in Sect. 12.3, we give a consistent geometric 
formalization of these constructions. Our presentation is based on the notion 
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of the natural projection introduced in section 12.4. We discuss in detail the 
method of natural projector as the consistent formalization of Ehrenfests’ 
ideas of coarse-graining. 

In Sect. 12.4.2 we introduce a one-dimensional model of nonequilibrium 
states. In the background of many derivations of nonequilibrium kinetic equa¬ 
tions one can imagine the following picture: Above each point of the qua- 
siequilibrium manifold there is located a huge subspace of nonequilibrium 
distributions with the same values of the macroscopic variables, as in the 
quasiequilibrium state. It seems that the motion of the nonequilibrium en¬ 
semble decomposes into two projections, transversal to the quasiequilibrium 
manifold, and in the projection on this manifold. The motion in each layer 
above the quasiequilibrium points is highly complicated, but fast, and every¬ 
thing quickly settles in this fast motion. 

However, upon a more careful looking into the motions of the ensem¬ 
bles which start from the quasiequilibrium points, we recognize that above 
each point of the quasiequilibrium manifold it is located just a single and 
in some sense monotonic curve, and all the relevant nonequilibrium (not- 
quasiequilibrium) states form just a one-dimensional manifold. 

The one-dimensional models of nonequilibrium states form a film of non¬ 
equilibrium states. In Sect. 12.5 we present a collection of methods for the film 
construction. One of the benefits from this new technique is the possibility to 
solve the problem of macro-kinetics even when there are no autonomous equa¬ 
tions of macro-kinetic for moment variables. The notion of the invariant film 
of non-equilibrium states, and the method of its approximate construction 
transform the problem of nonequilibrium kinetics into a series of problems of 
equilibrium statistical physics. 

The most important results of this chapter are: 

1. The notion of macroscopically definable ensembles is developed. 

2. The primitive macro scopically definable ensembles are described. 

3. The method for computing trajectories of primitive macroscopically defin¬ 
able nonequilibrium ensembles is elaborated. These trajectories are repre¬ 
sented a sequence of deformed quasiequilibrium ensembles connected by 
quadratic models. 

Let us give here an introductory description of these results. 

The notion of macroscopically definable ensembles consists of three ingre¬ 
dients: 

1. The macroscopic variables, the variables which values can be controlled by 
us; 

2. The quasiequilibrium state, the conditional equilibrium state for fixed val¬ 
ues of the macroscopic variables; 

3. The natural dynamics of the system, or the microscopic dynamics. 

We use the simplest representation of the control: At certain moments of 
time we fix some values of the macroscopic variables (one can fix all of all these 
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macroscopic variables, or only a part of them; for the whole system, or for 
macroscopically defined part of it; the current values, or some arbitrary values 
of these variables), and the system settles in the corresponding conditional 
equilibrium state. We can also keep fixed values of some macroscopic variables 
during a time interval. 

These control operations are discrete in time. The continuous control can 
be obtained by a closure: the limit of a sequence of macroscopically definable 
ensembles is macroscopically definable too. 

The role of the macroscopic variables for the irreversibility problem was 
clarified by M. Leontovich and J. Lebowitz several decades ago [288-292]. 
This was the first step. Now we do need the elaborate notion of ensembles 
which can be obtained by the macroscopic tools. The Maxwell Demon gives 
the early clear picture of a difference between the macroscopic and micro¬ 
scopic tools for the ensembles control (books are devoted to the studies of 
this Demon [293,294]). Nevertheless, a further step towards the notion of 
the macroscopic definability in the context of constructive transition from 
the microdynamics to macrokinetics was not done before the paper [33]. Our 
analysis is an analog of the Church-Turing thesis in the theory of computabil¬ 
ity [295,296]. This thesis concerns the notion of an effective (or mechanical) 
method in mathematics. As a “working hypothesis”, Church proposed: A 
function of positive integers is effectively calculable only if recursive. 

We introduce a class of “macroscopically definable ensembles” and formu¬ 
late the thesis: An ensemble can be macroscopically obtained only if macro¬ 
scopically definable according to the introduced notion. This is the thesis 
about the success of the formalization, as the Church-Turing thesis, and no¬ 
body can prove or disprove it in a rigorous sense, as well as this famous 
thesis. 

Another important new notion is the “macroscopically definable trans- 
formation” of the ensemble: If one got an ensemble, how can he transform 
it? First, it is possible just to let them evolve due to the natural dynamics, 
second, it can be controlled by the macroscopic tools in the prescribed way 
(it is necessary just to keep values of some macroscopic variables during some 
time). 

The primitive macroscopically definable ensembles are ensembles with 
quasiequilibrium initial states and without further macroscopic control. These 
ensembles are prepared macroscopically, and evolve due to the natural dy¬ 
namics. The significance of this class of ensembles is determined by the hy¬ 
pothesis about the primitive macroscopically definable ensembles : Any macro¬ 
scopically definable ensemble can be approximated by primitive macroscopi¬ 
cally definable ensembles with appropriate accuracy. After that there remains 
no other effective way to decribe the nonequilibrium state. 

The primitive macroscopically definable ensembles form the manifold in 
the space of ensembles. We call this manifold the “film of nonequilibrium 
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states”. The equation for the film and the equation for the ensemble motion 
on the film are written down. 

The film of nonequilibrium states is the trajectory of the manifold of initial 
quasiequilibrium states due to the natural (microscopic) dynamics. For every 
value of macroscopic variables this film gives us a curve. The curvature of 
this curve defines kinetic coefficients and the entropy production. 

The main technical problem is the computation of this curve for arbi¬ 
trary values of the macroscopic variables. We represent it as a sequence of 
distinguished states and second-order polynomial (Kepler) models for the tra¬ 
jectory between these points. This can be viewed as a further development of 
the method for initial layer problem in the Boltzmann kinetics (see Sect. 9.3 
and [26,27]). For the dissipative (Boltzmann) microkinetics it was sufficient 
to use the first-order models (with or without smoothing). For conservative 
microkinetics it is necessary to use the higher-order models. Applications of 
this method to the lattice kinetic equations (Sect. 2.7) allowed 

To create the lattice Boltzmann method with the 17-theorem [137]; 

To transform the lattice Boltzmann method into the numerically stable 
computational tool for fluid flows and other dissipative systems out of 
equilibrium [136]; 

- To develop the entropic lattice Boltzmann method as a basis for the for¬ 
mulation of a new class of turbulence models based on genuinely kinetic 
principles [66]. 

In this chapter we extend the method elaborated for dissipative systems 
[26,27] to the higher-order models for conservative systems. The constructing 
of the method of physically consistent computation is the central part of this 
chapter. 

The main results of this chapter were presented in the talk given at the 
First Mexican Meeting on Mathematical and Experimental Physics, Mexico 
City, September 10-14, 2001 [33], and in the lectures given on the V Russian 
National Seminar “Modeling of Nonequilibrium systems”, Krasnoyarsk, Oc¬ 
tober 18-20, 2002 [298]. 

12.2 The Problem of Irreversibility 

12.2.1 The Phenomenon of the Macroscopic Irreversibility 

The best way to get a feeling about the problem of irreversibility is the 
following thought experiment ( Gedankenexperiment ): Let us watch a movie: 
It’s raining, people are running, cars rolling. Let us now wind this movie in 
the opposite direction, and we shall see a strange and funny picture: Drops 
of the rain are raising up to the clouds, people run with their backs forward, 
cars also behave quite strange, and so forth. This cannot be true, and we 
“know” this for sure, we have never seen anything like this in our life. Let 
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us now imagine that we watch the same movie with a magnitude of 10 8 - 
10 9 so that we can resolve individual particles. And all of the sudden we 
discover that we cannot notice any substantial difference between the direct 
and the reverse demonstration: Everywhere the particles move, collide, react 
according to the laws of physics, and nowhere there is a violation of anything. 
We cannot tell the direct progressing of the time from the reversed. So, we 
have the irreversibility of the macroscopic picture under the reversibility of 
the microscopic one. 

Rain, people, cars - all this is too complicated. One of the simplest exam¬ 
ples of the irreversible macroscopic picture under the apparent reversibility 
of the microscopic picture is given by R. Feynman in his lectures on the 
character of physical law [297]. We easily label it as self-evident the fact that 
particles of different colors mix together, and we would deem it wonderful the 
reverse picture of a spontaneous decomposition of their mixture. However, by 
itself, an appreciation of one picture as usual, and of the other as unusual 
and wonderful - this is not yet physics. It is desirable to measure somehow 
this transition from order to disorder. 

12.2.2 Phase Volume and Dynamics of Ensembles 

Let there be n blue and n white particles in a box, and let the box is separated 
in two halves, the left and the right. Location of all the particles in the box is 
described by the assembly of 2 n vectors of locations of the individual particles. 
The set of all the assemblies is a “box” in the 6n-dimensional space. A point 
in this 6n-dimensional box describes a configuration. The motion of this point 
is defined by equations of mechanics. 

“Order” is the configuration in which the blue particles are all in the 
right half, and all the white particles are in the left half. The set of all such 
configurations has a rather small volume. It makes only (1/2) 2n of the total 
volume of the 6n-dimensional box. If n = 10, this is of the order of one per 
million of the total volume. It is practically unthinkable to land into such 
a configuration by a chance. It is also highly improbable that, by forming 
more or less voluntary the initial conditions, we can observe that the system 
becomes ordered by itself. From this standpoint, the motion goes from the 
states of “order” to the state of “disorder”, just because there are many more 
states of “disorder”. 

However, we have defined it in this way. The well known question of what 
has more order, a fine castle or a pile of stones, has a profound answer: It 
depends on which pile you mean. If “piles” are thought as all configurations of 
stones which are not castles, then there are many more such piles, and so there 
is less order in such a pile. However, if these are specially and uniquely placed 
stones (for example, a garden of stones), then there is the same amount of 
order in such a pile as in a fine castle. Not a specific configuration is important 
but an assembly of configurations embraced by one notion. 
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This transition from single configurations to their assemblies (ensembles) 
play the pivotal role in the understanding of irreversibility: The irreversible 
transition from the ordered configuration (blue particles are on the right, 
white particles are on the left) to the disordered one occurs simply because 
there are many more of the disordered (in the sense of the volume). Here, 
strictly speaking, we have to add also a reference to the Liouville theorem: 
The volume in the phase space which is occupied by the ensemble does not 
change in time as the mechanical system evolves. Because of this fact, the 
phase volume V is a good measure to compare the assemblies of configu¬ 
rations. However, more often the quantity InV is used, this is called the 
entropy. 

The point representing the configuration, very rapidly leaves a small 
neighborhood and for a long time (in practice, never) does not return into it. 
In this, seemingly idyllic picture, there are still two rather dark clouds left. 
First, the arrow of time has not appeared. If we move from the ordered initial 
state (separated particles) backwards in time, then everything will stay the 
same as when we move forward in time, that is, the order will be changing 
into the disorder. Second, let us wind the film backwards, let us shoot the 
movie about mixing of colored particles, and then let us watch in the reverse 
order their demixing. Then the initial configurations for the reverse motion 
will only seem to be disordered. Their “order” is in the fact that they were 
obtained from the separated mixture by letting the system to evolve for the 
time t. There are also very few such configurations, just the same number 
as of the ordered (separated particles) states. If we start with these configu¬ 
rations, then we obtain the ordered system after the time t. Then why this 
most obvious consequence of the laws of mechanics looks so improbable on 
the screen? Perhaps, it should be accepted that states which are obtained 
from the ordered state by a time shift, and by inversion of particle’s veloc¬ 
ities (in order to initialize the reverse motion in time), cannot be prepared 
using macroscopic means of preparation. In order to prepare such states, one 
would have to employ an army of Maxwell’s Demons which would invert in¬ 
dividual velocities with sufficient accuracy (here, it is much more into the 
phrase “sufficient accuracy” but this has to be discussed separately and next 
time). 

For that reason, we lump the distinguished initial conditions, for which 
the mixture decomposes spontaneously (“piles” of special form, or “gardens 
of stones”) together with other configurations into macroscopically definable 
ensembles. And already for these ensembles the spontaneous demixing be¬ 
comes improbable. This way we come to a new viewpoint: (i). We cannot 
prepare individual systems but only representatives of ensembles, (ii) We 
cannot prepare ensembles at our will but only “macroscopically definable en¬ 
sembles” . What are these macroscopically definable ensembles? It seems that 
one has to give some constructions, the universality of which can only be 
proven by time and experience. 
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There is one property that distinguishes an arbitrary ensemble with phase 
volume V and ensembles (with the same volume) that we usually associate 
with the order. This property is observability. Usually we can fix a configu¬ 
ration within some error only, this means that we cannot distinguish points, 
if the distance between them is less then some e > 0. Hence, the observable 
ensemble should not change its volume significantly, if we replace all points 
by the 6-small balls (i.e. if we just add a small ball to the set of states, or, if 
the ensemble is presented by the distribution density, just average the density 
over such balls). This operation, averaging over small balls or cells, is called 
coarse graining. The observable state should not significantly change its vol¬ 
ume after the coarse-graining. The ordered state (the blue particles are all in 
the right half, and all the white particles are in the left half, for example) is 
observable, but dynamics makes it unobservable after some time. Of course, 
the notion of macroscopically definable ensembles should meet the expecta¬ 
tion concerning observability as well as implementability and controlability 
of these ensembles. 

12.2.3 Macroscopically Definable Ensembles and Quasiequilibria 

The main tool in the study of the macroscopically definable ensembles is 
the notion of the macroscopic variables, and of the quasiequilibria. In the dy¬ 
namics of the ensembles, the macroscopic variables are defined as linear func¬ 
tionals (moments) of the density distribution of the ensemble. Macroscopic 
variables M usually include the hydrodynamic fields: density of particles, 
density of momentum, and density of energy. This list may also include the 
stress tensor, the reaction rates and other quantities. In the present context, 
it is solely important that the list the macroscopic variables is identified for 
the system under consideration. 

A single system is characterized by a single point x in the phase space. 
The ensemble of the systems is defined by the probability density F over 
the phase space. The density F must satisfy a set of restrictions, the most 
important of which are: Nonnegativity, F(x) > 0, normalization, 

[ F(x) dV(x) = l, (12.1) 

Jx 

and that the entropy is defined, that is, there exists the integral, 

S(F) = — [ F(x)lnF(x)dV{x) . (12.2) 

Jx 

The function FlnF is continuously extended to zero values of F: OlnO = 0). 
Here, dU (x) is the invariant measure (phase volume. 

The quasiequilibrium ensemble describes the “equilibrium under restric¬ 
tions” . It is assumed that some external forcing keeps the given values of the 
macroscopic variables M, with this, “all the rest” comes to the equilibrium. 
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The corresponding (generalized) canonical ensemble F which is the solution 
to the problem: 

S(F) -> max, M(F) = M . (12.3) 

where S(F) is the entropy, M(F ) is the set of macroscopic variables. 

The thesis about the macroscopically definable ensembles. Micro¬ 
scopically definable ensembles are obtained as the result of two operations: 

1. Bringing the system into the quasiequilibrium state corresponding to ei¬ 
ther the whole set of the macroscopic variables M, or to its subset; 

2. Evolution of the ensemble according to the microscopic dynamics (due to 
the Liouville equation) during some time t. 

These operations can be applied in the interchanging order any number 
of times, and for arbitrary time segments t. The limit of macroscopically 
definable ensembles will also be termed macroscopically definable. One always 
begins with the first operation. 

In order to work out the notion of macroscopic definability, one has to 
pay more attention to partitioning the system into subsystems. This involves 
a partition of the phase space X with the measure dV into a direct prod¬ 
uct of spaces, X = X\ x X 2 with the measure dVidV^. To each admissible 
(“macroscopic”) partition into sub-systems, it corresponds the operation of 
taking a “partial quasiequilibrium”, applied to some density Fq(xi,x 2 ): 


S(F) —> max , (12.4) 

M(F) = M, [ F(x u x 2 ) dV 2 (x 2 )= [ F 0 ( Xll x 2 )dV 2 (x 2 ) . 

Jx 2 Jx 2 

where M is some subset of macroscopic variables (not necessarily the whole 
list of the macroscopic variables). In (12.4), the state of the first subsystem 
is not changing, whereas the second subsystem is brought into the quasiequi¬ 
librium. In fact, the problem (12.4) is a version of the problem (12.3) with 
additional “macroscopic variables”, 


L 


F(xi,x 2 )dV 2 (x 2 ) . 


(12.5) 


The extended thesis about the macroscopically definable ensembles allows 
to use also operations (12.4) with only one restriction: The initial state should 
be the “true quasiequilibrium”, that is, macroscopic variables related to all 
possible partitions into subsystems should appear only after the sequence 
of operations has started with the solution to the problem (12.3) for some 
initial M. This does not exclude a possibility of including operators (12.5) 
into the list of the basic macroscopic variables M. The standard example of 
such an inclusion are few-body distribution functions treated as macroscopic 
variables in derivations of kinetic equations from the Liouville equation. 
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Irreversibility is related to the choice of the initial conditions. The ex¬ 
tended set of macroscopically definable ensembles is thus given by three ob¬ 
jects: 

1. The set of macroscopic variables M which are linear (and, in an appropri¬ 
ate topology, continuous) mappings of the space of distributions onto the 
space of values of the macroscopic variables; 

2. Macroscopically admissible partitions of the system into sub-systems; 

3. Equations of the microscopic dynamics (the Liouville equation, for 
example). 

The choice of the macroscopic variables and of the macroscopically ad¬ 
missible partitions is a distinguished topic. The main question is: which vari¬ 
ables are under the macroscopic control? Here the macroscopic variables are 
represented as formal elements of the construction, and the arbitrariness is 
removed only at solving specific problems. Usually we can postulate some 
properties of macroscopic variables, for example, symmetry with respect to 
any permutation of equivalent particles. 

We have discussed the prepared ensembles. But there is another statement 
of the problem: Let an ensemble be just given. The way it emerged it may 
be irrelevant or unknown, for example, some demon or oracle 1 can prepare 
the ensemble for us. How can we transform this ensemble by the macroscopic 
tools? First, it is possible just to let it evolve, second, it can be controlled 
by the macroscopic tools in the prescribed way (it is necessary just to keep 
values of some macroscopic variables during some time). 

The thesis about the macroscopically definable transformation 
of ensembles. Macroscopically definable transformation of ensembles are 
obtained as the result of two operations: 

1. Bringing the system into the quasiequilibrium state corresponding to ei¬ 
ther the whole set of the macroscopic variables M, or to its subset. 

2. Changing the ensemble according to the microscopic dynamics (due to the 
Liouville equation, for example) during some time t. 

These operations can be applied in the interchanging order any number of 
times, and for arbitrary time segments t. The limit of macroscopically defin¬ 
able transformations will also be termed macroscopically definable. The main 
difference of this definition (macroscopically definable transformation) from 
the definition of the macroscopically definable ensembles is the absence of 
the restriction on the initial state, one can start from an arbitrary ensemble. 

The class of macroscopically definable ensembles includes a simpler, but 
important subclass. Let us reduce the macroscopic control to preparation 
of the initial quasiequilibrium ensemble: we just prepare the ensemble by 
macroscopic tools and then let it evolve due to the natural dynamics (Liouville 


1 In the theory of computation, if there is a device which could answer questions 
beyond those that a Turing machine can answer, then it is called the oracle. 
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equation, for example). Let us call this class the primitive macroscopically 
definable ensembles. These ensembles appear as the results (for t > 0) of 
motions which start from the quasiequilibrium state (at t = 0). The main 
technical focus of our work concerns the computation of the manifold of 
primitive macroscopically definable ensembles for a given system. 

The importance of this subclass of ensembles is determined by the fol¬ 
lowing hypothesis. The hypothesis about the primitive macroscopi¬ 
cally definable ensembles. Any macroscopically definable ensemble can 
be approximated by primitive macroscopically definable ensembles with an 
appropriate accuracy. In certain limits we can attempt to say: “with any ac¬ 
curacy”. Moreover, this hypothesis with “arbitrary accuracy” can be found 
as the basic but implicit foundation of all nonequilibrium kinetics theories 
which claim derivation the macrokinetics from microdymamics, for example 
Zubarev’s nonequilibrium statistical operator theory [195]. This hypothesis 
allows us to describe nonequilibrium state as a result of evolution of quasi¬ 
equilibrium state in time. 

The hypothesis about the primitive macroscopically definable ensembles is 
a hypothesis indeed, it can hold for different systems with different accuracy, 
it can be valid or invalid. In some limits the set of primitive macroscopically 
definable ensembles can be dense in the set of all macroscopically definable 
ensembles, or, in some cases it can be not dense. There is a significant differ¬ 
ence between this hypothesis and the thesis about macroscopically definable 
ensembles. The thesis can be accepted, or not, the reasons for its acceptance 
can be discussed, but nobody can prove or disprove the definition, even the 
definition of the macroscopically definable ensembles. 

12.2.4 Irreversibility and Initial Conditions 

The choice of the initial state of the ensemble plays the crucial role in the 
thesis about the macroscopically definable ensembles. The initial state is al¬ 
ways taken as the quasiequilibrium distribution which realizes the maximum 
of the entropy for given values of the macroscopic variables. The choice of the 
initial state splits the time axis into two semi-axes: moving forward in time, 
and moving backward in time. In both cases the observed disorder increases 
(the simplest example is the mixing of the particles of different colors). 

In some works, in order to achieve the “true nonequilibrium”, that is, the 
irreversible motion along the whole time axis, the quasiequilibrium initial 
condition is shifted to — oo in time. This trick, however, casts some doubts, 
the major being this: Most of the known equations of the macroscopic dy¬ 
namics describing irreversible processes have solutions which can be extended 
backwards in time only for finite times (or cannot be extended at all). Such 
equations as the Boltzmann kinetic equation, diffusion equation, equations 
of chemical kinetics and like do not allow for almost all their solutions to be 
extended backward in time for indefinitely long. All motions have a “begin¬ 
ning” beyond which some physical properties of a solution will be lost (often, 
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positivity of distributions), although formally solutions may even exist, as in 
the case of ordinary differential equations of chemical kinetics. 


12.2.5 Weak and Strong Tendency to Equilibrium, 

Shaking and Short Memory 

One aspect of irreversibility is the special choice of the initial conditions. 
Roughly speaking, the arrow of time is defined by the fact that the quasi¬ 
equilibrium initial condition was in the past. 

This remarkably simple observation does not, however, exhaust the prob¬ 
lem of transition from the reversible equations to the irreversible macroscopic 
equations. One more aspect deserves a serious consideration. Indeed, distri¬ 
bution functions tend to the equilibrium state according to the macroscopic 
equations in a strong sense: deviations from the equilibrium tends to zero in 
the sense of most relevant norms (in the L 1 sense, for example, or even uni¬ 
formly). On the contrast, for the Liouville equation, the tendency to equilib¬ 
rium occurs (if at all) only in the weak sense: the average values of sufficiently 
“regular” functions on the phase space do tend to their equilibrium values 
but the distribution function itself does not tend to the equilibrium with re¬ 
spect to any norm, not even point-wise. This is especially easy to appreciate 
if the initial state was the equipartition over some small bounded subset of 
the phase space (the “phase drop” with small, but non-zero volume). This 
phase drop can mix over the phase space, but for all the times it will remain 
“the drop of oil in the water”, the density will be always taking only two 
values, 0 and p > 0, and the volume of the set where the density is larger 
than zero will not be changing in time, of course. So, how to arrive from the 
weak convergence (in the sense of the convergence of the mean values), to the 
strong convergence (to the L 1 or to the uniform convergence, for example)? 
In order to do this, there are two basic constructions: The coarse-graining 
(shaking) in the sense of Ehrenfests’, and the short memory approximation. 

The idea of coarse-graining dates back to P. and T. Ehrenfests, and it 
has been most clearly expressed in their famous paper of 1911 [15]. Ehren¬ 
fests considered a partition of the phase space into small cells, and they have 
suggested to supplement the motions of the phase space ensemble due to the 
Liouville equation with “shaking” - averaging of the density of the ensem¬ 
ble over the phase cells. In the result of this process, the convergence to the 
equilibrium becomes strong out of the weak. It is not difficult to recognize 
that ensembles with constant densities over the phase cells are quasiequilib¬ 
ria; corresponding macroscopic variables are integrals of the density over the 
phase cells (“occupation numbers” of the cells). This generalizes to the fol¬ 
lowing: alternations of the motion of the phase ensemble due to microscopic 
equations with returns to the quasiequilibrium manifold, preserving the val¬ 
ues of the macroscopic variables. The formalization of this idea was given in 
the previous chapter. 
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12.2.6 Subjective Time and Irreversibility 

In our discussion, the source of the arrow of time is, after all, the asymmetry of 
the subjective time of the experimentalist. We prepare initial conditions, and 
after that we watch what will happen in the future but not what happened in 
the past. Thus, we obtain kinetic equations for specifically prepared systems. 
How is this related to the dynamics of the real world? These equations are 
applicable to real systems to the extent that the reality can be modeled with 
systems with specifically prepared quasiequilibrium initial conditions. This is 
anyway less demanding than the condition of quasi-staticity of processes in 
classical thermodynamics. For this reason, versions of nonequilibrium thermo¬ 
dynamics and kinetics based on this understanding of irreversibility allowed 
to include such a variety of situations, and moreover, they include all classical 
equations of nonequilibrium thermodynamics and kinetics. 


12.3 Geometrization of Irreversibility 

12.3.1 Quasiequilibrium Manifold 

We remind here some of the constructions from Chap. 5. Let E be a linear 
space, and U C E be a convex subset, with a nonempty interior inti/. Let 
a twice differentiable concave functional S be defined in inti/, and S be 
continuous on U. According to the familiar interpretation, S is the entropy, 
E is an appropriate space of distributions, U is the cone of nonnegative 
distributions from E. Space E is chosen in such a way that the entropy is 
well defined on U. 

Let IF be a closed linear subspace of space E , and m : E —> E/K be 
the natural projection on the factor-space. The factor-space L = E/K will 
further play the role of the space of macroscopic variables (in examples, the 
space of moments of the distribution). 

For each M G intra(I/) we define the quasiequilibrium, G inti/, as the 
solution to the problem, 


S(f) —► max, m(f) = M . (12.6) 

We assume that, for each M G m(t/), there exists the (unique) solution to the 
problem (12.6). This solution, , is called the quasiequilibrium, correspond¬ 
ing to the value M of the macroscopic variables. The set of quasiequilibria 
fiM forms a manifold in inti/, parameterized by the values of the macroscopic 
variables M G mtU/L (Fig. 12.1). 

Let us specify some notations: E T is the adjoint to the E space. Adjoint 
spaces and operators will be indicated by T , whereas notation * is earmarked 
for equilibria and quasiequilibria. 

Furthermore, [l,x] is the result of application of the functional l G E T to 
the vector xgL We recall that, for an operator A : Ei —» £ 2 , the adjoint 
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Fig. 12.1. Relations between a microscopic state /, the corresponding macroscopic 
state M = m(/), and quasiequilibria 

operator, A T : Ef —► Ej is defined by the following relation: For any l G E^ 
and x € Ei, 


[l, Ax] = [ A T l , x\ . 

Next, DfS(f) G E T is the differential of the functional S(f), D 2 S(f) 
is the second differential of the functional S(f). Corresponding quadratic 
functional D 2 S(f)(x,x) on E is defined by the Taylor formula, 

S(f + x) = S(f) + [D f S(f),x] + ^DjS(f)(x,x) + o(\\x\\ 2 ) . (12.7) 

We keep the same notation for the corresponding symmetric bilinear form, 
D 2 S(f)(x,y ), and also for the linear operator, D 2 S(f ) : E —► E T , defined 
by the formula, 


[D 2 f S(f)x,y\ = DjS{f)(x,y) . 

In this formula, on the left hand side there is the operator, on the right 
hand side there is the bilinear form. Operator D 2 rS(f) is symmetric on E , 
DjS(f) T = DjS(f). 

Concavity of S means that for any x G E the inequality holds, 

D)S{f){x,x)< 0; 
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in the restriction onto the affine subspace parallel to K = ker m we assume 
the strict concavity, 

DfS(f)(x , x) < 0 if x G K and 

A comment on the degree of rigor is in order: the statements which will be 
made below become theorems or plausible hypotheses in specific situations. 
Moreover, specialization is always done with an account for these statements 
in such a way as to simplify the proofs. 

Let us compute the derivative Dm/m- For this purpose, let us apply 
the method of Lagrange multipliers: There exists such a linear functional 
A(M) G L T , that 


DfS(f )| = A{M) • m, m(r M ) = M, 

J M 

(12.8) 

or 


D fS(f)\ f , M =m T -A(M), m{f* M ) = M. 

(12.9) 

From equation (12.9) we get, 


m(D M fM ) = 1 (L) ! 

(12.10) 


where we have indicated the space in which the unit operator is acting. Next, 
using the latter expression, we transform the differential of the equation 
( 12 . 8 ), 

D m A = (m(D 2 S) f }m T ) 1 , (12.11) 

and, consequently, from (12.9) 

Dm fit = * ( 12 . 12 ) 

Notice that, elsewhere in equation (12.12), operator acts on the 

linear functionals from im(m T ). These functionals are precisely those which 
become zero on K (that is, on ker(ra)), or, which is the same, those which 
can be represented as functionals of macroscopic variables. 

The tangent space to the quasiequilibrium manifold in the point is 
the image of the operator Dm/m- 

im (Dm fit) = (D 2 S)jHm(m T ) = (D 2 S)j^ArmK (12.13) 

where Ann K (the annulator of if) is the set of linear functionals which be¬ 
come zero on K. Another way to write equation (12.13) is the following: 

X G im (Dm/m) ^ ( D2 fS)p M (x,y) = 0, y G K (12.14) 

This means that im (Dm/m) orthogonal completement of K in E with 

respect to the scalar product, 
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QE Projector 



7L* = (D 2 S)' 1 m T (m(D 2 S)' 1 m T )' 1 m 

t M 

A = J-7WJ) 

'M 


Fig. 12.2. Quasiequilibrium manifold 12, tangent space Tf*^i 7, quasiequilibrium 
projector 717 ^, and defect of invariance, A — Af^ — J — 7T/^.(J) 


( x \y)r M = ~( D 2 f s )r M ( x ’y) ■ 


(12.15) 


The entropic scalar product (12.15) appears often in the constructions 
below. (Usually, this becomes the scalar product indeed after the conservation 
laws are excluded). Let us denote as = impM/y the tangent space 
to the quasiequilibrium manifold in the point An important role in the 
construction of quasiequilibrium dynamics and its generalizations is played by 
the quasiequilibrium projector , an operator which projects E on Tf*^ parallel 
to K. This is the orthogonal projector with respect to the entropic scalar 
product, n rM : E -► T fSt : 



(12.16) 


It is straightforward to check the equality . and the self-adjointness 

of 7 Tf^ with respect to entropic scalar product (12.15). Thus, we have in¬ 
troduced the basic constructions: quasiequilibrium manifold, entropic scalar 
product, and quasiequilibrium projector (Fig. 12.2). 

12.3.2 Quasiequilibrium Approximation 

Let a kinetic equation be defined in U : 



(12.17) 
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(This can be the Liouville equation, the Boltzmann equation, and so on, 
dependent on which level of precision is taken for the microscopic description.) 
One seeks the dynamics of the macroscopic variables M. If we adopt the 
thesis that the solutions of the equation (12.17) of interest for us begin on 
the quasiequilibrium manifold, and stay close to it for all the later times, then, 
as the first approximation, we can take the quasiequilibrium approximation. 
It is constructed this way: We regard / as the quasiequilibrium, and write, 

^ = m(J(r M )). (12.18) 

With this, the corresponding to M point on the quasiequilibrium manifold 
moves according to the following equation: 

d f* 

= (. D M f* M )m(J(f * M )) = tt , (12.19) 

where iTf^ is the quasiequilibrium projector (12.16). 

Let us term function S(M) = S(f^) the quasiequilibrium entropy. Let us 
denote as dS(M)/dt the derivative of the quasiequilibrium entropy due to 
the quasiequilibrium approximation (12.18). Then, 


d S(M) 
d t 


d S(f) 


dt 


f=fh 


( 12 . 20 ) 


From the identity (12.20), it follows the theorem about preservation of 
the type of dynamics: 

(i) If for the original kinetic equation (12.17) dS(f)/dt = 0 at f — /^, 
then the entropy is conserved due to the quasiequilibrium system (12.19). 

(ii) If for the original kinetic equation (12.17) dS(f)/dt > 0 at / = /^, 
then, at the same points /^, dS(M)/dt > 0 due to the quasiequilibrium 
system (12.18). 

The theorem about the preservation of the type of dynamics 2 demon¬ 
strates that if there was no dissipation in the original system (12.17) (if the 
entropy was conserved) then there is also no dissipation in the quasiequilib¬ 
rium approximation. The passage to the quasiequilibrium does not introduce 
irreversibility. The reverse may happen, for example, there is no dissipa¬ 
tion in the quasiequilibrium approximation for hydrodynamic variables as 
obtained from the Boltzmann kinetic equation (the compressible Euler equa¬ 
tions). Though dissipation is present in the Boltzmann equation, it occurs 
in different points but on the quasiequilibrium manifold of local Maxwellians 
the entropy production is equal to zero. The same statement also holds for 

2 This is a rather old theorem, one of us had published this theorem in 1984 already 
as a textbook material ( [115], chapter 3 “Quasiequilibrium and entropy maxi¬ 
mum”, p. 37, see also the paper [29]), but from time to time different particular 
cases of this theorem are continued to be published as new results. 
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the thermodynamic projectors described in Sect. 5.3. On the other hand, the 
entropy production in the quasiequilibrium state is the same as for the qua¬ 
siequilibrium system in the corresponding point, hence, if the initial system 
is dissipative, then quasiequilibrium entropy production is nonnegative. 

Usually, the original dynamics (12.17) does not leave the quasiequilibrium 
manifold invariant, that is, the vector field J(f) is not tangent to the qua- 
siequilibrium manifold in all its points In other words, the condition of 
invariance (see Chap. 3), 


(l-7r^)J(/^)=0, (12.21) 

is not satisfied on the quasiequilibrium manifold. The left hand side of the 
invariance condition (12.21) is the defect of invariance , and we denote it as 
Af* M (Chap. 3). It is possible to consider the invariance condition as an equa¬ 
tion, and to compute corrections to the quasiequilibrium approximation f\^ 
in such a way as to make it “more invariant”. If the original equation (12.17) 
is already dissipative, this route of corrections, supplemented by the con¬ 
struction of the projector as in Sect. 5.3, leads to an appropriate macroscopic 
kinetics [11]. 

However, here, we are mainly interested in the route “from the very be¬ 
ginning” , from conservative systems to dissipative. And here solving the in¬ 
variance equation does not help since it will lead us to “more invariant” but 
still conservative dynamics. In all the approaches to this problem (passage 
from the conservative to the dissipative systems), dissipation is introduced in 
a more or less explicit fashion by various assumptions about the “short mem¬ 
ory” . The originating point of our constructions is the absolutely transparent 
and explicit approach of Ehrenfests. 


12.4 Natural Projector 

and Models of Nonequilibrium Dynamics 

12.4.1 Natural Projector 

So, let the original system (12.17) be conservative, and thus, dS(f)/dt = 0. 
The idea of Ehrenfests is to supplement the dynamics (12.17) by coarse- 
graining (“shakings”). The coarse-graining steps are external perturbations 
which are applied periodically with a fixed time interval r, and which lead to 
“forgetting” of the small scale (nonequilibrium) details of the dynamics. For 
us here the coarse-graining is the replacement of / by the quasiequilibrium 
distribution . In the particular case which was originally considered in by 
Ehrenfests, the macroscopic variables m(f) were the averages of / over cells 
in the phase space, while was the cell-homogeneous distribution with 

the constant density within each cell equal to the corresponding cell-average 
of /. In the limit r —> 0, one gets back the quasiequilibrium approximation - 
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and the type of the dynamics is preserved. In this limit we obtain just the 
usual projection of the vector field J(f) (12.17) on the tangent bundle to the 
quasiequilibrium manifold. 

So, the natural question appears: What will happen, if we shall not just 
send r to zero but will consider finite, and even large, r? In such an approach, 
not just the vector fields are projected but segments of trajectories. We shall 
term this way of projecting the natural. Let us now pose the problem of the 
natural projector formally. Let T t (f) be the phase flow of the system (12.17). 
We must derive a phase flow of the macroscopic system, 0 t (M) (that is, the 
phase flow of the macroscopic system, dM/dt = F(M), which we are looking 
for), such that, for any M, 


m(T T (f * M )) = 0 t (M) . (12.22) 

That is, when moving along the macroscopic trajectory, after the time r we 
must obtain the same values of the macroscopic variables as if we were moving 
along the true microscopic trajectory for the same time r, starting with the 
quasiequilibrium initial condition (Fig. 12.3). 

The final form of the equation for the macroscopic variables M (see 
Chap. 11) may be written: 

= F(M) = )) + (T/2)m(D f J(f)\ f . u A r J + o(r 2 ) . (12.23) 



V f*eQ 7i(T x f*)= 0 T (f) 

Fig. 12.3. Projection of segments of trajectories: The microscopic motion above 
the manifold 17 and the macroscopic motion on this manifold. If these motions 
began in the same point on 17, then, after time r, projection of the microscopic 
state onto 17 should coincide with the result of the macroscopic motion on 17. For 
quasiequilibrium 17, projector tt : E -0 17 acts as 7 r(/) = fm(f) 
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It is remarkable the appearance of the defect of invariance in the second term 
(proportional to r): If the quasiequilibrium manifold is invariant with respect 
to the microscopic dynamics, then F(M ) is the quasiequilibrium state. 

The formula for the entropy production follows from (12.23): 

A ^ = (t/ 2)(A,.JA i . m ),. m . (12.24) 

The quasiequilibrium entropy increases due to the equation of the macro¬ 
scopic dynamics (12.23) in those points of the quasiequilibrium manifold 
where the defect of invariance is not equal to zero. This way we see how 
the problem of the natural projector (projected are not vector fields but 
segments of trajectories) results in the dissipative equations. For specific ex¬ 
amples see [30] and Chap. 11. The second term in equation (12.23) results 
in viscosity and heat conductivity terms in the Navier-Stokes equations, dif¬ 
fusion and other dissipative contributions. However, it remains the unde¬ 
termined parameter r. Formula (12.24) gives the entropy production just 
proportional to the time interval between subsequent coarse-grainings. Of 
course, this could be true only for small enough r, whereas we are mostly 
interested in the limit r —> oc. It is only in this limit where one can eliminate 
the arbitrariness in the choice of r present in equations (12.23) and (12.24). 
In order to do this, we need to study more carefully the structure of the 
trajectories which begin on the quasiequilibrium manifold. 


12.4.2 One-Dimensional Model of Nonequilibrium States 

In the background of many derivations of nonequilibrium kinetic equations 
one can recognize the following picture: Above each point of the quasiequi¬ 
librium manifold there is located a huge subspace of nonequilibrium distri¬ 
butions with the same values of the macroscopic variables, as in the quasi- 
equilibrium. It is as if the motion decomposes into two projections, above 
the point on the quasiequilibrium manifold, and in the projection on this 
manifold. The motion in each layer above the quasiequilibria is extremely 
complicated, but fast, and everything quickly settles in this fast motion. 

However, upon a more careful looking into the motions which begin in 
the quasiequilibrium points, we shall observe that, above each point of the 
quasiequilibrium manifold it is located just a single and in certain sense 
monotonic curve. All the nonequilibrium (not-quasiequilibrium) states which 
come into the game form just a one-dimensional manifold. This is the curve of 
the primitive macroscopically definable ensembles. These ensembles appear as 
the result (for t > 0) of motions which start from the quasiequilibrium state 
(at t = 0). It is namely this curve the construction of which we shall be 
dealing with in this chapter. 

For each value of the macroscopic variables M, and for every time r > 0, 
we define M_ r by the following equality: 
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m(T T (f* M _ T )) = M . (12.25) 

In other words, M_ r are those values of macroscopic variables which satisfy 
@ r (M_ r ) = M for the natural projector (12.22). Of course, it may well 
happen that such M_ r exists not for every pair (M, r) but we shall assume 
here that for every M there exists tm > 0, so that there exists M_ r for 
0 < r < tm- 

A set of distributions, qm,t — ), forms precisely the desired curve 

of nonequilibrium states with the given values of M. Notice that, for each r, 
it holds, m(qM,r) = M. The set {qM,r} for all possible M and r is positive 
invariant: If the motion of the system starts on it at some time to, it stays 
on it also at t > to- If the dependence qM,r is known, equations of motion in 
the coordinate system (M, r) have a simple form: 

%= 1 • (i2 - 26> 

^ = m(J(q M ,r)) ■ 

The simplest way to study qM,r is through a consideration of a sequence 
of its derivatives with respect to r at fixed M. The first derivative is readily 
written as, 

= J{f* M )-n rM J{r M ) = A rM . (12.27) 

T = 0 

By the construction of the quasiequilibrium manifold (we remind that K = 
kerm), for any x G iF, 

Sift, + TX ) = Sift,) - (t 2 /2 ){x\x) fli + o(t 2 ) . 


dgM,r 

dr 


Therefore, 


Sim,r) = Siftt) - ir 2 m^rJ^r M )r M +o{r 2 ). 

Thus, to first order in r, we have, as expected, 

<?m,t = f* M + rA fli + o(r) . 

Let us find </m,t to the accuracy of the order o(r 2 ). To this end, we expand 
all the functions in equation (12.25) to the order of o(r 2 ). With 

M- T = M — )) + t 2 B{M) + o(t 2 ) , 

where function B is yet unknown, we write: 

/m_ t = ft, - tDm/WT/m)) + T 2 D M f* M B(M ) + (t 2 /2)A 2 (M) + o(r 2 ) , 


where 
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and 


A 2 (M) 


d2 f*M+tm{J{r M )) 


d t 2 


t =o 


(12.28) 


T r (x + ra) = x + tol + rJ(x) + r 2 Z) x J(x) \ x a 

+(t 2 /2)D x J(x)\ x J(x) + o(t 2 ) , 

T T {fM_ r ) = Sm- + T 2 D M f* M B{M) + ( t 2 /2)A 2 (M ) 

+tJ(/m) - T 2 DfJ{f)\ rM D M r M m{J{r M )) 

+(r 2 /2)D f J(f)\ f , M J(r M )+o(T 2 ) 

= r M +TA f , M + (T 2 /2)A 2 (M) 

+(T 2 /2)D f J(f)\ r Jl-2n rM )J(r M ) 

+T 2 D M f* M B(M) + o(r 2 ) . 

The latter somewhat lengthy expression simplifies significantly under the 
action of m. Indeed, 

m(A 2 (M)) = d 2 [M + tm(J(f* M ))]/dt 2 = 0 , 

m ( 1 - 7r /D = 

m(D M f * M ) = 1 . 


Thus, 

m(T T (r M _ T )) = M+(T 2 /2)m(D f J(f)\ (1-2* r JJU m))+t 2 B{M)+o{t 2 ) , 

J M 

B{M) = (l/2)m(D f J(f)\ r j2n rM - 1 )J(f* M )) . 

Accordingly, to second order in r, 

QM,T = T T (f* M _ T ) (12.29) 

= /m + t ^/m + ( t 2 / 2 )A 2 (M) 

+( t 2 / 2)(1 - 7 t / ^)£) / J (/)| / ^(1 - 2 t + o(r 2 ) . 

Notice that, besides the dynamic contribution of the order of r 2 (the last 
term), there appears also the term A 2 (12.28) which is related to the curvature 
of the quasiequilibrium manifold along the quasiequilibrium trajectory. 

Let us address the behavior of the entropy production in the neighborhood 
of fjM- Let x G K (that is, m{x) = 0). The production of the quasiequilibrium 
entropy, crj f (x), equals, by definition, 


4W — ^M<5(/m) • + x )) • 


(12.30) 
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Equation (12.30) gives the rate of the entropy change under the motion of 
the projection of the state onto the quasiequilibrium manifold if the true 
trajectory passes the point + x. In order to compute the right hand side 
of equation (12.30), we use essentially the same argument, as in the proof of 
the entropy production formula (12.24). Namely, in the point /jj^, we have 
K C kerDfS(f) \ ,* , and thus DtS(f) I ,* 717 * = DfS(f) I ,* . Using this, and 
the fact that the entropy production in the quasiequilibrium approximation 
is equal to zero, equation (12.30) may be written, 

= D f S(f) L ( J(f* M +x)~ J(f* M )) • (12.31) 

To the linear order in x, the latter expression reads: 

a* M (x) = D f S(f)\ f , M D f J(f)\ f , M X . (12.32) 

Using the identity 

DjS(f)\ f J(f) + D f S(f)\ f D f J(f)\ f = 0 , (12.33) 

we obtain in equation (12.32), 

a* M (x) = -D}S(f)\ r JJ(f* M ),x ) = \x) Pm . (12.34) 

Because x G iF, we have (1 — 7 Tf*^)x = x, and 

(J(r M )\x)r„ = ( j (/m)I ( 1 - *fh) x )fh 

= ((! - nr M )J{f* M )\x)r M = ( A r M \ x )r M ■ 

Thus, finally, the entropy production in the formalism developed here, to the 
linear order reads, 

a* M (x) = (A r Jx) rM . (12.35) 

The above consideration gives us the simplest way to study the primitive 
macroscopically definable ensembles using Taylor expansion in r. This way 
has obvious limitations because r remains a parameter of the theory. 


12.4.3 Curvature and Entropy Production: 

Entropic Circle and First Kinetic Equations 

In a consequent geometric approach to the problem of constructing the one¬ 
dimensional model of nonequilibrium states it is more relevant to consider 
the entropic parameter, SS = S*(M) — S instead of r. Within this parame¬ 
terization of the one-dimensional curve of the nonequilibrium states one has 
to address functions ctm(AS), rather than 

In order to give an example here, we notice that the simplest geometric 
estimate amounts to approximating the trajectory qM, r with a second order 
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curve 3 . Given qM, r and q_M,r (12.29), we construct a tangent circle (in the 
entropic metrics, (|)/^, since the entropy is the integral of motion of the 
original equations). For the radius of this circle we compute 


R = 


(gM,o|gM,p)/^ 





(12.36) 


where 


q M ,o = Aft 


Q± M, o = Qm,o — 




Qm, o = (1 -Kp M ) D fJ{f)\ r (1 - 2tt f M )J{fh) + (- D M ^)m(J(fM )) 


Let us represent the microscopic motion as a circular motion along this 
entropic circle with the constant “linear velocity” qM ,o = After the 

microscopic motion passed the quarter of the circle, the entropy production 
begins decreasing and it becomes equal to zero after passing the semicircle. 
Hence, after passing the quarter of the circle, this model should be changed. 
The time of the motion along the quarter of the entropic circle is: 


2 y (q± M,o\q± M,o)r M 


(12.37) 


After averaging over the 1/4 of this circle we obtain the macroscopic 
equations 


d M 
d t 


= m(J f* M + -R 


2 At> 

— J M 


II *lt 


+ 



Q .L M, 0 \ \ 
ll4f_L M,o\\JJ 


+ (‘ - l) ".»)) + »<*> -I 12 - 38 ) 


where \\y\\ = ^{y\y)r M - 

Equations (12.38) contain no undetermined parameters. This is the sim¬ 
plest example of a general macroscopic equations obtained by the natural 
projector. The coefficients (2/7r, etc.) can be corrected, but the form is more 
universal. The entropy production for equations (12.38) is proportional both 
to the defect of invariance and to the radius of curvature: 


3 We shall argue below in detail, why the first-order estimates, qM,r = fM+TAf* M , 
are insufficient in the case of the conservative dynamics. 
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a M =-R\\Af* M \\ ■ (12.39) 

This equation demonstrates the thermodynamical sense of curvature of the 
curve of the nonequilibrium states. The combination 


defect of invariance 
curvature 


(12.40) 


is the dissipation (recall that all the scalar products and norms are entropic). 


12.5 The Film of Non-Equilibrium States 

12.5.1 Equations for the Film 

The set qm,t in the space E forms a “surface” parameterized by “two vari¬ 
ables” : A scalar, r > 0, and the value of the macroscopic variables, M, subject 
to the condition 


M = m(q M ,r ) • (12.41) 

We call this surface the film of non-equilibrium states or simply the film. It 
consists of the primitive macroscopically definable ensembles , the result (for 
t > 0) of motions which start from the quasiequilibrium state (at t = 0). 

For each r > 0 the section of the film is defined: the set, qM,r ? for a 
given r. It is parameterized by the value of M. For r = 0 the section of 
the film coincides with the quasiequilibrium manifold. The film itself can be 
considered as a trajectory of motion of the section under the variation of 
r G [0; Too). It is not difficult to write down equations of this motion using 
the definition of 

q M ,r = T r f* M _ T , (12.42) 

where T r is the phase flow of the microscopic dynamical system, M_ r is 
defined with equation (12.25). 

For small At 


Qm,t+At = Qm—am,t + J{qM,r)Ar + o(Ar) , (12.43) 

where AM = mJ(qM,r)AT. Hence, 

^ ,T = (1 - D M q M , T m)J((lM,T) • (12.44) 

The initial condition for equation (12.44) is the quasiequilibrium 

<ZAf, 0 = f*M • (12.45) 

Equation (12.44), subject to the initial condition (12.45), defines the film 
of non-equilibrium states in the space E. This film is a minimal positive 
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invariant set (i.e invariant with respect to the shift T r for positive times 
r > 0), including the quasiequilibrium manifold, All of the macroscopic 
kinetics take place only on this film. 

Thus, the study of the non-equilibrium kinetics can be separated into two 
problems: 

1. Construction of the film of non-equilibrium states: solution of equation 
(12.44) with the initial condition (12.45). 

2. Investigation of the motion of the system on the film. 

Of course, one should assume that the film will be constructed only approx¬ 
imately. Therefore, the second problem in turn should be separated in two 
subproblems: 

Construction of projection of the microscopic vector field J on the ap¬ 
proximately found film, and construction of equations for M and r. 

- Investigation and solution of equations for M and r. 

It should be emphasized that the existence of the film is not signifi¬ 
cantly questionable (though, of course, proving theorems about existence and 
uniqueness for (12.44), (12.45) can turn into a hard mathematical problem). 
In a contrast, existence of kinetic coefficients (viscosity etc.), and generally, 
of the fast convergence of dM/dt to a certain dependence dM/dt of M is 
essentially a hypothesis which is not expected to always be true. 

Below we mostly deal with the problem of construction of equations: the 
problems iil) and ii2). And we shall begin with the problem ii2). Thus, let 
the film be approximately constructed. 


12.5.2 Thermodynamic Projector on the Film 

We need the projector in order to project the vector field on the tangent space. 
The method of the thermodynamic projector ( [9,10] and Chap. 5) allows to 
characterize every manifold (subject to certain requirements of transversality) 
as the quasiequilibrium one. This is achieved by a construction of a projection 
of a neighborhood of the manifold. The projection of the neighborhood on 
the manifold should satisfy essentially only one condition: a point of the 
manifold must be the point of maximum of the entropy on its preimage. If 
the preimage of the point /* is a domain in the affine subspace, Kf* C E, 
then the required condition is the property A (5.37): 


(DfS)f*(Kf* — /*) = 0 . (12.46) 


where Kf * — /* is the linear subspace in E because /* £ Kf*. 

For the projections with the property A (5.37), a dissipative vector field 
is projected into a dissipative one, and a conservative vector field (with the 
entropy conservation) is projected into a conservative one, i.e. the entropy 


350 12 Geometry of Irreversibility: The Film of Nonequilibrium States 

balance is exact. Thus, let the film, Qm,ti be defined, and let us construct for 
it the projector. 

Under small variation of variables M and r 


Ac[m,t = D M qM,rAM + D r q M , r AT + o(AM, At) , 
AS = D f S | 9MjT Aq M , T + o(AM, At) . 


(12.47) 


After simple transformations we obtain: 


At 


AS - DfS\ qMtT D M qM,rAM 


AqM.r 


1 - 


D f D T qM,i 

DtQM,tD fS\q M , T 
DfS\q MjT D r qM,T 
D T qM,rAS 


+ o(AM, AS) , 


DmQm,tAM 


o(AM, AS) . 


(12.48) 


DfS\q MjT D r qM : ' 

From this formulae we obtain the projector with the property A for J, 7 Ta: 


7TA 


Qm, 


J = 


1 - 


D T qM,rDfS\ 


QM,- 


DfS\q MjT D r qM,T _ 

DrqM,rDfS\q M , 

DfS\q MjT D r qM,' 




-J . 


(12.49) 


It is straightforward to check the equality = 7 Ta- For the conservative 
vector fields J(/), the second term in (12.49) vanishes because DfS\f(J(f)) = 
0, and 


7TA 


Qm, 


J = 


1 - 


D T qM,rDfS\ 

Qm,- 




DfS\q MjT D r qM,' 

The equation for M corresponding to (12.50) has the form: 


(12.50) 


= ™<>a| 9 mAA<?M,t))) 

D r qM, t Df S | q M} , 


1 - 


DfS\q MjT D r qM,T _ 

= mJ(q M ,r) • 


DMqM,T^J{qM,r) 


(12.51) 


By the definition of the projector with the property A the equation for M 
(12.51) should be supplemented with the equation for S: 


d S 

di = 0 ’ 


(12.52) 


or for r, in accordance with (12.48) 
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Dynamic Equation on The Film 



Fig. 12.4. Dynamics on the film: M m mJ(qM,r ), r = f D ™ qM ' T — 


dr _ S - DfS\ qM T D M qM, T M _ DfS\ qM T D M qM, T M 
dt D f S\q M ^ DtQ_M,t f ^\qm,t DtQm,t 


where M is defined in accordance with (12.51). The numerator in (12.53) 
has a simple meaning: it is the rate of the entropy production by dynamic 
equations (12.51) when r is constant (for frozen r). Expression (12.53) can 
be obtained from the condition of the constant entropy for the motion on 
the film in accordance with (12.51,12.53). Equations (12.51,12.53) describe 
dynamics on the film (Fig. 12.4). 

The system of equations (12.51,12.53) has a very simple sense: 

dM T/ , dS n 

— = = ° • (12.54) 

It is just the standard moment equation supplied by the equation of entropy 
production (in this case by the equation of entropy conservation). 

It should be emphasized that the projector with the property A is not 
unique, and here we made the simplest choice. 

Let us further assume that condition (12.27) is satisfied: 


QM,t = f*M + TAf* M + o ( t ) . 

In expressions (12.48,12.51,12.53) the denominator, DfS\ qM T D r qM, T , is pre¬ 
sent. For r —» 0 this expression vanishes: 


-^r^M,r|r=0 — 5 

DfS\f=f^x = 0, for x G kerm , 


(12.55) 
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= 0, therefore DfS\ qMi _D T qM :T —► 0 for r —> 0. For r —> 0 inde¬ 
terminate forms 0/0 appear in expressions (12.48-12.50,12.52,12.53). Let us 
resolve the indeterminate forms and calculate the corresponding limits. 

Two indeterminate forms are present: 

AT {D T qM,r)(DfS\q M , T )DMCLM,T' m J ho 

n q I Dr/ G^.ooj 

I QM,T-^rQM,r 

and the right hand side of equation (12.53), 7V 2 (t). Let us evaluate the form 
(12.56). We obtain: 


lim Ni(r) 

t— 


(Z\ f * \Af * ) f* 

' 1 JM' J M 


using identity (12.33), similar to (12.24), we obtain: 


lim iV 2 (r) 

T —>-0 


Z\ f* (Z\ f * \Af* ) f* 

J M ' J M ' J M ' J M 

(A f* I A f* ) f* 

' J M 1 J M > J M 


= -A + 


(12.57) 


Therefore, for r —* 0 

\qM,T > Dm f (/m) A ^/m 

= ^ A/m) + (1 - *r M Wh) = A/m) • (12.58) 

Similarly, after simple calculations we obtain that: 

d t 

— —> 1, for r —> 0 . (12.59) 

The fact that for r —> 0 the action of the projector 7 Ta on J becomes 
trivial, 7 Ta J = J, can be obtained (without calculations) from the construc¬ 
tion of Qm,t in the vicinity of zero. We have chosen this dependence in such 
a way that J(qM,r) becomes transverse to the film for r —> 0. This follows 
from the condition (12.27). Let us emphasize, however, that derivation of the 
formulas (12.50-12.53) themselves was not based on (12.27), and they are 
applicable to any ansatz, qM,n not necessarily with the right behavior near 
the quasiequilibrium (if one needs such an ansatz for anything). 

12.5.3 Fixed Points of the Film Equation 

What features can one expect from the dynamics of the film according to 
equation (12.44)? A naive expectation that qm,t tends to a stable fixed point 
of equation (12.44) leads to somewhat strange consequences. Fixed point for 
equation (12.44) is the invariant manifold qM- On this manifold, 


= D M qMmJ(q M ) 


( 12 . 60 ) 
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i.e. the projection of the vector field, J, onto qm coincides with J. Were 
the condition qM, r —> Qm satisfied for r —> oc, the dynamics would become 
“more and more conservative”. On the limit manifold qm-, the entropy should 
be conserved. This leads to unusual consequences. The first of them is the 
limited extendability backwards “in the entropy”. 

Indeed, let us consider the set of points M_ r (12.25) for a given M. There 
exists the limit, 

lim T T (f* M T ) = q M , 

T—»00 T 

The flow T r conserves the entropy, hence, the difference of the values of the 
quasiequilibrium entropy, S(M ) — S(M_ r ) = AS r , is bounded on the half¬ 
axis, r G [0;+oo) : AS r < Z\S' 00 (M). This means that it is impossible to 
get into the values of macroscopic variables, M, from the quasiequilibrium 
initial conditions, Mi, for that S(M) — S(Mi) > AS 00 (M). Thus, possible 
fixed points of the equation (12.44), regardless of their obvious interest, likely 
demonstrate some exotic possibilities. 

12.5.4 The Failure of the Simplest 

Galerkin-Type Approximations for Conservative Systems 

Usually, the simplest approach to the problem is the projection approxima¬ 
tion: one considers a projection of the vector field, J(/), onto the manifold in 
question and investigates the obtained equations of motion. However, it is not 
difficult to see sure that such an approach is unfruitful in the present case 
of conservative systems. If the orthogonal with respect the entropic scalar 
product projection is taken, then only the quasiequilibrium approximations 
with increased number of moments could be obtained. 

For the dissipative systems, in contrast, such a projection approximations 
leads to quite satisfactory results. For example, if for the Boltzmann equation 
and the hydrodynamic moments the approximate invariant manifold is to be 
searched in the form + a(M)Af^, where is local Maxwellian, 

then we obtain the Navier-Stokes equations with the viscosity and heat con¬ 
ductivity calculated within the first Sonine polynomials approximation. Using 
another scalar product simply leads to unphysical results. 

In order to highlight the pitfall in the conservative case, let us give an 
example with a linear field, J(f) = A/, and a quadratic entropy, S(f) = 
(1/2) (/|/). The conservativity of J means that for each / it holds 

(f\Af) = 0 . (12.61) 

The quasiequilibrium subspace corresponding to the moments M = mf 
is the orthogonal complement, kerM. The quasiequilibrium projector, 7r, is 
an orthogonal projector on this subspace. For the defect of invariance Af ** 
we obtain: 


A ru = (A-*A)fa. 


( 12 . 62 ) 
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Under the simplest projection approximation we write 


Projector on is 


Qm,t = f*M + a(M,T)A f * M . 

(12.63) 

14/m) (A/m 1 

A/m 1 Af£f ) 

(12.64) 


Thus, we pass from the equation of motion of the film (12.44) to the 
Galerkin-type approximation for a(M, r). 


& = 1 + _ a _(^/m I 


( A f . \A f * 

' J M 1 JJV 


M ' 


I A/m ) 


2 /n \ A/m 

—a —- (DMCi)m- 


■ aAAf* 
j \ 


( A f. 


M 


I^/m) 


(^/x 


I^/m) 


(12.65) 


One can try to find fixed points (solving a = 0). This is the projected 
invariance equation. Due to the properties of the operator A , and the self- 
adjoint projector, 7r, we obtain for conservative systems 


( A r M \ AA r M ) = 0 > ( 12 - 66 ) 

( A r M \ A 7 rAA r M ) = ~(^ AA r M IM 2 - ( 7 rA ) 2 ) A r M > • ( 12 - 67 ) 

On the other hand, for the dissipative systems the form (12.66) is nega¬ 
tively definite, and it is this form that determines the Navier-Stokes equations 
(in the first Sonine’s polynomials approximation) in the derivation of these 
equations from the Boltzmann equation. For the conservative equations this 
main part vanishes, while the second term in equation (12.65), generally 
speaking, is sign-indefinite. 

The failure of the projection approximations becomes even more obvious 
in the equations of motions on the film. Here everything is very simple: 


a = 1 + a 


I Afjtf) 


( 12 . 68 ) 


For the dissipative systems under frozen M, a relaxes to the stable point 


A/m I 

A/mAA fjh) 


> 0 . 


(12.69) 


This fixed point is “the leading order term” in the solution of the invari¬ 
ance equation, a = 0 (12.65). 

However, for the conservative systems a = 1. This result was expected 
from the entropy production formula (12.24), and 


S(f) = (l/2)</|/) = (l/2)(7r/|7r/) + (1/2)((1 - tt)/|(1 - n)f) . 
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12.5.5 Second Order Kepler Models of the Film 

In the problems of the dissipative kinetics (namely, in the problem of the 
initial layer for the Boltzmann equation) it was found efficient to approxi¬ 
mate the trajectories by segments (with further smoothing and corrections, 
or without them). These segments were constructed in the following way: the 
initial direction of motion was taken, and / evolved along this direction for 
as long as the entropy increases. Further, the procedure was repeated from 
the obtained point (for details see [26,27] and Sect. 9.3). 

Unfortunately, in the problem of the initial layer for the conservative 
systems there are no termination points during the motion along a straight 
line (more precisely, the beginning of the motion itself can be considered 
as a termination point because under the linear approximation the relation 
(12.66) is valid). In the initial layer for the dissipative systems the motion of 
the system along the straight line x = rA in any case increases the entropy. 
For the conservative systems one needs to “rotate the phase”, and the models 
of motion should be arcs of ellipses (in linear space), or the constant entropy 
lines, rather than straight lines. In the film problem the simplest “good” 
model is a general conic section. A simple example: J(f) = Af , A is generator 
of rotation around the axis with the direction r = e x + ae y , M = x, the film 
is the lateral surface of the cone, obtained by rotation of the quasiequilibrium 
manifold, the axis {re x }, around the axis {pr}. For a < 1 the curve qM,r is 
an ellipse, for a > 1 it is a hyperbole, for a = 1 it is a parabola. 

The curve qM,r is an intersection of two manifolds: one of them is the 
result of the motion of the quasiequilibrium manifold along the vector field 
J(/), other is the linear manifold + kerm. 

Already in the finite-dimensional space, and under linear approximation 
(J is linear, S is quadratic), we have an interesting geometrical picture: quasi¬ 
equilibrium manifold is an orthogonal complement to kerm, A is the rotation 
generator, (ker m) A is rotated under action of e Ar , the unknown curve is the 
section: 


(/m + ker m) Q e AR + (ker m) 1 - , (12.70) 


where R+ = [0; oo), G (kerm)- 1 . 

Thus, the simplest model motion is a second order curve. However, it is 
not sufficient to know the first and the second derivatives. We need infor¬ 
mation about the third-order derivative. If we consider the curve Qm,t as 
a trajectory in the Kepler problem, then the location, r, of the center of 
attraction (repulsion) is (Fig. 12.5): 


r 


Qo 


•• (gxl gx) 
(® \q±) ’ 


(12.71) 


where qo is the initial point where all the derivatives are taken. The force is: 
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Second order models 



Fig. 12.5. The definition of the second-order models 


F = a --- • 

(r — q\r — g) 3 / 2 

a 2 = (q\q)(r - q\r - qf = ; (12.72) 

(9 | q ±) 4 


a > 0 (attraction) if (q \q±) < 0 ; 

a < 0 (repulsion) if (q \q±) > 0 . 


(12.73) 


It is necessary to point out that the Kepler problem defines an approxi¬ 
mation of the trajectory gM,r, but not the dependence on r. 

An important question is the finiteness of the film. Is the model motion 
finite? The answer is simple in terms of the Kepler problem [182]: 

Nil 2 r « 

2 Ik-9o| ’ 


or 


Here 


M 2 l(g±l g)l 

2||4J 2 ll<i1l 2 


(12.74) 


(d)/ m) 1/2 norm i n the entropic scalar product, as usual. 


12.5.6 The Finite Models: Termination at the Horizon Points 


In order to construct a step-by-step approximation it is necessary to solve 
two problems: the choice of the direction of the next step, and the choice of 
the size of this step. 
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The Film for dissipative systems: 
step by step 


Terminal points 
in directions A' 



/ Terminal points 
/ in directions A 


M, M 2 M 3 M 4 m 

But... there are no terminal points 
in directions A for conservative systems 


Fig. 12.6. The stepwise construction of the film for dissipative system. First-order 
models: The motion along the defect of invariance 

If the motion Qm,t is taken along the straight line (dissipative sys¬ 
tems), the direction of the step is qM,r 0 (let us remind that qM,r 0 is the defect 
of the invariance of the manifold qM = #m,t 0 at fixed r = To), and the size 
of the step should be adjusted in such a way as to reach a stable point, that 
is, the point where the direction qM,r becomes orthogonal to the initial one, 
qM,r 0 (Fig- 12.6). The current direction of c[m,t is calculated with the help of 
(12.44), where the projector is frozen (L>M#M,T 0 m instead of DMqM,r m )- 

For the conservative systems we have chosen the second order models 
instead of the linear ones. For finiteness of the models we need to define the 
moments of termination of motion. It is suggested to operate in a manner 
similar to the case of the dissipative systems: to stop at the moment when 
the direction of the motion becomes orthogonal to the initial one. 

Thus, if qM,r 0 is a starting point of motion, and qM,r 0 +6 is a motion on 
the finite second order model, then the condition for the transition to the 
next model is 



(12.75) 


(in the entropic scalar product). 

Let us call the horizon points such points, gM,T 0 +6> 0 ? where the scalar 
product (12.75) for the first time becomes equal to zero (for 0 < 0 < 6o 
this scalar product is positive). This notion is motivated by the fact that 
for 0 > Oq the motion on the second order model “disappears behind the 
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The Film for conservative systems: 
second order steps 



Fig. 12.7. The stepwise construction of the film for conservative system. Finite 
second-order models: The motion starts in the direction of the defect of invari¬ 
ance, and stops when the direction of motion becomes orthogonal to the defect of 
invariance 


horizon”, and its orthogonal projection on the line parallel to 4m, r 0 starts to 
move back passing the same points for the second time. 

The convention about the change of the model in the horizon points seems 
quite natural. The following sequence of calculations becomes self-explaining 
(Fig. 12.7): 

1. we seed the film with the quasiequilibrium manifold, qM,o = /m; 

2. we calculate 4m, o, 4 m, ce • • • in accordance with equation (12.44); 

3. we construct the (finite) second order models, qM,e ; 

4. we find the horizon points, qM,o 0 (M)i from (12.75); 

5. then we take the manifold of the horizon points as a new initial manifold, 
and dio the next iteration. 

At a first glance, this sequence contradicts the original statement of the 
film problem. The manifold qM,o 0 (M) does not have the form of qM,r for a 
fixed r and thus it is not a shift of the quasiequilibrium manifold by the given 
time along the true microscopic equations of motion. 

The second difficulty was already mentioned: the time of motion along 
the model curve does not coincide with the proper time, r. More precisely, 
it coincides only within the second order. However, now global, not local 
approximation are constructed. Therefore, global corrections to the time, or 
ways to circumvent these corrections, are required. 
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The following two subsections are devoted to the elimination of these 
difficulties. 

12.5.7 The Transversal Restart Lemma 

Let qM, r (t G [0; +oo)) be the solution to (12.44) under initial condition 
(12.45) (the film). We call the transverse section of the film, Qm,t, the mani¬ 
fold, qM,o(M)i where 6(M) is a smooth function 0 < 6(M) <t< oo. 

Let the transversality condition be satisfied. Namely, for every bounded 
domain that does not include equilibrium there exists 5 > 0 such that in this 
patch 


II J (QM,0(M) ) — D M qM,0(M) m J{QM,0(M)) II 
\\J(Qm,0(m))\\ 


(12.76) 


in an appropriate norm. Let c[m,t be the solution to (12.44) under the initial 
condition qM,o = Qm,0(m)- Then the following transverse restart lemma is 
valid: 



(12.77) 


here q M ,[a-,b] = Um,t\t G [a; b}}. 

The transversality condition (12.76) can be understood as a condition of 
an “uniform noninvariance”. As we already know, fixed points of the film 
equations are irrelevant. 

The transversal restart lemma is the statement about the correctness of 
the film. One way to derive the film is to seed it at the quasiequilibrium edge 
and to evolve in r to Too along the film equation (12.44). Another way is to 
evolve it to some transverse section, not obligatory uniformly in time, and 
then continue growing the film from this new edge. The result will be the 
same. 

In order to “prove” 4 this lemma, we notice that it is equivalent to the 
following statement. For every M the segment of the trajectory, 7~/~ (r G 
[0;£]), crosses the manifold qM,0(M), and only once. 

In order to demonstrate the unicity of the section, we consider the film 
in another coordinates, for each point q we set M and r: q = 7V/~. In these 
coordinates the transversality condition excludes folds on qM,0(M )• 

In order to demonstrate the existence of the crossing point, g*, of the 
segment 7~/~ (t G [0; t]) with the section manifold gM,6>(M)> we define in the 
neighborhood of the point f~ on the quasiequilibrium manifold the mapping 
into the neighborhood of this section point. Image of the point /— is section 
of the trajectory 7~/~ (r G [0; t]) with the manifold qM,0(M) m the neighbor¬ 
hood of q*. Due to the transversality condition, it performs an isomorphism 

4 Let us remind that within the degree of generality used here there are no proofs 
to the theorems of existence and uniqueness. 
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of the neighborhoods. Therefore, the set of M for which the section of the 
trajectory with qM,o(M) exists is open. Furthermore, it is closed, because 
the limit of section points is a section point (and segment [0; t] is compact). 
Obviously, it is not empty. Consequently, it is the set of all possible M. 

12.5.8 The Time Replacement, and the Invariance 
of the Projector 

Let the film of nonequilibrium states be constructed as c[m,9, where relation 
between 0 and r is implicit; r = r(M,0), 0 = 0(M,r). In order to deter¬ 
mine these functions one needs to solve equation obtained from (12.44) with 
substitution qM, r = ( an d projection, because q is only an approxi¬ 

mation). The calculation itself presents no difficulties. However, is it possible 
to avoid the inversion in replacing of time for a derivation of the kinetic equa¬ 
tions? In another words, could we use the constructed geometrical object, the 
film, without an exact reconstruction of the time, r, on it? 

For a positive answer to this question it is sufficient to demonstrate that 
the equations of motion, constructed with the projector (12.51-12.53), de¬ 
scribe the same motion on the film after the time replacement. 

This property of the tta is evident: while deriving equations (12.51-12.53), 
we did not use that r is the “true time” from the equation (12.44), and made 
the local replacement of variables, passing from Z\M, At to Z\M, AS. 

Thus, the projector tta is invariant with respect to the time replacement, 
and, when constructing equations of motion, it is not necessary to restore the 
“true time”. 

Results of this and previous subsections allow to apply the sequence of 
operations suggested in Subsect. 12.5.6. 

12.5.9 Correction to the Infinite Models 

Let an infinite model qM,o, £ [0; Too)), qm ,o = /m be constructed for the 
film. Actually, it means that an approximation is constructed for the whole 
film qM,r (not just for its initial segment, as it was for the finite models). 
Naturally, there arises a problem of correction to this approximation, and, in 
general, construction of a step-by-step computational procedure. 

The projector tta on the film is defined (12.50). Correspondingly, the 
invariance defect of the film is determined too 


Aq M ,e = (1 - tta | q M , 0 )J(qM,e) 



(12.78) 


It is easy to verify, that if qM,o is a solution to (12.44), then AqM,e = 0. 
Subsequently we calculate the corrections to qM, r using an iterative 
method for the manifold correction (see Chaps. 6 and 9). 
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Generally speaking, one could (and should) calculate these corrections 
also for the finite models. However, the infinite models are distinguished, 
because they require such corrections. 

12.5.10 The Film, and the Macroscopic Equations 

Let the film of nonequilibrium states be constructed. What next? There are 
two routes. 

1. Investigation of the conservative dynamics of “N + 1” variables, where 
“TV” is moments for the moments M, and “+1” is for the coordinate r on 
the film; 

2. Derivation of the macroscopic equations for M. 

Actually, the second route is more desirable, it leads to familiar classes of 
kinetic equations. The first one, however, is always available, because the 
film exists always (at least formally) but the existence of equations for M is 
not guaranteed. 

The route of obtaining equations for M is essentially the same as suggested 
by us [29], [30-33] following Ehrenfests [15], and Zubarev [195]. That is, 

- One chooses a time T. 

- For arbitrary Mo one solves the problem of the motion on the film ( 12 . 51 ), 
( 12 . 53 ) under initial conditions M(0) = Mq, t ( 0 ) = To on the segment 
t G [0;T]. The solution is M(t,Mo). 

- For the mapping M 0 —> M{T ) the system dM/dt = F(M) is constructed. 
It has the property that for its phase flow, 0 t (M ), the identity 


£ t (Mo) = M(T,M 0 ) 


(12.79) 


is satisfied. This is the method of natural projector once again (see (12.22) 
and Chap. 11). 

In this sequence of actions there are two nontrivial problems: solution to the 
equations on the film, and reconstruction of the vector field by transformation 
of the phase flow, under fixed T. 

The natural method for solving the first problem is the averaging method. 
The equations of motion on the film read 


M = eP(M, t) ; f = Q(M,r) 


(12.80) 


where 6 is (formally) small parameter. 

Assuming that the motion of M is slow, one can write down the series of 
the Bogoliubov-Krylov averaging method [183]. The first term of this series 
is a simple averaging over the period T : t\ (T, M) is solution to the equation 
f = Q(M, r) under fixed M, 
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Mi (£, Mq) — Mq + et 



(12.81) 


for t E [0; T], and 


M 1 (T,Mo) = M 0 + 5 [ T P(M 0 ,T(6,M 0 ))d6 , (12.82) 

J o 

correspondingly. 

The first correction to the reconstruction of the vector field, F(M), by 
the transformation of the phase flow, 0t{M ), is very simple too: 


F 1 (M) = - M) . 


(12.83) 


Hence, we obtain the first correction to the macroscopic equations: 


M = Fi(M) = iy m(J(q M , T (t,M))) dt > (12.84) 

where r(t, M) is a solution to the equation (12.53) under fixed M (actually, 
mJ(q M ,r) should be substituted into (12.53) instead of M). 

The second and higher approximations are much more cumbersome, but 
their construction is not a principal problem. 

In general, the sequence of the horizon points of the second order finite 
Kepler models and corresponding g^, qi determines the macroscopic kinetic 
equations. Only the values of the coefficients remain unknown. Let us start 
from linearized in layers system (12.17) 


/ = JCC (/) ) + L mU) {f - /* (/) ) , (12.85) 

where linear operator Lm parameterized by macroscopic variables M = 
m(/). For the system (12.85) the second order finite Kepler models give 
the macroscopic equation 


M = + Y^( a i m ( L M(qi)) + Pirn(L M (qi))) , (12.86) 

i 


with ai, fa > 0. 

The final comment on the positivity of the “kinetic coefficients” and pi 
is important, and cannot be easily verified every time. However, in the case 
under consideration it is so by the following theorem. 

The theorem about the positivity of kinetic constants. The motion 
on the Kepler ellipse from start to the horizon point always satisfies the 
property 


q — qo = aq + Pq ; o, P > 0 


(12.87) 
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where go is a starting point, g, and g are the velocity, and the acceleration, 
correspondingly. 

This theorem follows from elementary theorems about analytical geome¬ 
try of second-order curves: Let a chord in an ellipse is passing through a focus, 
and Zi ? 2 a re the tangents to the ellipse at the ends of this chord. Then the 
angle between Zi ?2 that is based on the chord is acute. The starting point go 
is one of the ends of the chord, the vector of acceleration g is the direction of 
the chord (from go to the focus), the velocity vector g is the tangent direction 
at the point go- Following these elementary facts, the horizon point belongs 
to the arc on which the angle between Zi j2 is based, hence the positivity 
condition (12.87) holds. 

For the model motion on the entropic circle, strictly speaking, this is not 
always the case. Positivity of the coefficients is guaranteed only for m(L(g)), 
and m(L(q±)). 

Two phenomena can be related to the increase of the number of terms 
in (12.86) as compared to the short-memory approximation: (i) alteration of 
the kinetic constants (terms are not orthogonal to each other, therefore, new 
terms contribute to the previous processes), (ii) birth of new processes. 

Motion on an infinite film can lead to stabilization of kinetic coefficients as 
the functions of M, but it can also lead to their permanent transformation. In 
the second case one has to introduce into macroscopic equations an additional 
variable, the coordinate r on the film. 

From the applications point of view, another form of equations of mo¬ 
tion on the film could be more natural. In these equations kinetic coefficients 
are used as dynamic variables. Essentially, this is just another representa¬ 
tion of equations (12.51), (12.53). For every kinetic coefficient, fc, expres¬ 
sion dk/dt = ^(r, M) = (pk(k,M ) is calculated in accordance with (12.51), 
(12.53). Substitution of variables (r, M ) —> (fc, M ) in this equation is possible 
(at least locally) if value k does not stabilize during the motion on the film. 
Finally, we have the system in the form: 

M = m(J(f* M )) + Y, kjFj(M) ; kj = <Pj(kj,M) . (12.88) 

3 

For the motion starting from the quasiequilibrium state the initial conditions 
are kj =0. 

12.5.11 New in the Separation of the Relaxation Times 

Originally, there are no dissipative possesses in the quasiequilibrium state 
(the theorem of preservation of the type of dynamics for the quasiequilibrium 
approximation). 

The first thing that occurs during the motion out of the quasiequilibrium 
initial conditions is the emergence of the dissipation. It can be described (in 
the first non-vanishing approximation) by equation (12.23). It is of special 
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importance that there is yet no separation into dissipation processes with 
various relaxation times and kinetic coefficients on that stage. This separation 
occurs at further stages: Various processes appear, their kinetic coefficients 
are determined (see, for example, (12.86)) (or, in certain cases, the dynamics 
of the kinetic coefficients is determined). 

Generalizing, we can distinguish three stages: 

1. birth of dissipation; 

2. branching of dissipation: appearance of various processes; 

3. macroscopic relaxation. 

It is important to notice in this scheme that the determination of the kinetic 
coefficients can occur at both stages: at the second stage when macroscopic 
(hydrodynamic) relaxation can be described in the usual form with kinetic 
coefficient as functions of the macroscopic parameters, as well as in the third 
phase (motion on the film), when the hydrodynamic description includes 
dynamics of the kinetic coefficients also. 


12.6 The Main Results 

In order to solve the problem of irreversibility we have introduced the notion 
of the macros comically definable ensembles. They result from the evolution of 
ensembles out of the quasiequilibrium initial conditions under macroscopic 
control. 

Technically, the solution to the problem of irreversibility looks as follows: 
we can operate only with the macroscopically definable ensembles; the class of 
these ensembles is not invariant with respect to the time inversion. The notion 
of the macroscopically definable ensembles casts the problem of irreversibility 
into a new setting. It could be called a control theory point of view. The key 
question is: Which parameters can we control? These those parameters are 
fixed until “all the rest” come into equilibrium. The quasiequilibrium states 
are obtained in such a way. 

A further development of this direction should lead to investigation of the 
macro-dynamics under controlled macro-parameters. This will be a supple¬ 
ment of the postulated quasiequilibrium initial conditions with an investiga¬ 
tion of a general case of an evolution of the controlled ensembles. 

The method of the natural projector allows us to construct an approx¬ 
imate dynamics of macro-variables. When the time of projection, r, tends 
to infinity, these equations should tend to the actual equations of macro¬ 
dynamics, if the latter exist. This hypothesis about their existence in the 
thermodynamic limit (first, the number of particles N —> oc, and after that, 
the time of projection r —> oc) is the basis of Zubarev’s nonequlibrium sta¬ 
tistical operator approach [195]. 

Here, we need to make a remark. Frequently, physicists use mathemati¬ 
cal objects whose existence and uniqueness are not proven: solutions to the 
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equations of hydro- and gaso-dynamics, kinetic equations etc. Often, the fail¬ 
ure to prove theorems of existence and uniqueness is viewed as a lack of an 
adequate mathematical statement of the problem (definition of spaces, etc.). 
For all this, it is assumed that essential obstacles either are absent, or can 
be sorted out separately, independently of the theorem proof in physically 
trivial situations. Existence (or non-existence) of the macroscopic dynamics 
is a problem of a different kind. The cases of non-existence can be found as 
frequently as the physically expected existence. 

The notion of the invariant film of non-equilibrium states, and the method 
of its approximate construction allows us to solve the problem of macro¬ 
kinetics even when there are no autonomous equations of macro-kinetics. 
The existence of the film seems to be one of the physically trivial problems of 
existence and uniqueness of solutions. Further computations will show how 
productive the methods of film construction are. 

The formula for entropy production , 

defect of invariance 

(7 rsj - 

curvature 

clarifies the geometrical sense of the dissipation. Here, “defect of invariance” 
is the defect of invariance of the quasiequilibrium manifold, and “curvature” 
is the curvature of the film of nonequilibrium states in the direction of the 
defect of invariance of the quasiequilibrium manifold. 

At least one essential problem remains unsolved. This is the problem of 
indivisible events : For a macroscopically small time, a small microscopic sub¬ 
systems can go through “its whole life”, from the beginning to the limit state 
(or, more accurate, to the limit behaviour which may be not only a state, but 
a type of motion, etc.). The microscopic evolution of the system in a small 
interval of the macroscopic time cannot be written in the form 

Af = fAt . 

The evolution of the microscopic subsystems in a macroscopically small time 
At should be described as an u ensemble of indivisible events”. An excel¬ 
lent hint is given by the Boltzmann equation with its indivisible collisions, 
another good hint gives the chemical kinetics with indivisible events of ele¬ 
mentary reactions. The useful formalism for a description such ensembles of 
indivisible events is well developed. It is the “quasi-chemical” representation 
(see Chap. 7). But the way from general system to such ensembles remains 
unclear and presents the challenge to the future works (see, however, section 
“Neurons and particles” in the paper [10]). 

There is an important link between the theory of invariant film and the 
Hilbert method in the theory of the Boltzmann equation (see Chap. 2). The 
Hilbert method constructs the invariant film for the Boltzmann equation, and 
the initial manifold for this film is the local Maxwellian manifold (the local 
equilibrium manifold). The significant novelty of the theory of the invariant 
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film of non-equilibrium states is the splitting of the problem in two parts: the 
geometrical part (construction of the film) and the dynamical part (dynamics 
on the film). The first (geometrical) part is solved here by the method of 
“large stepping” instead of a Taylor series expansion as in the original Hilbert 
method. 


13 Slow Invariant Manifolds for Open Systems 


13.1 Slow Invariant Manifold for a Closed System 
Has Been Found. What Next? 

Suppose that the slow invariant manifold is found for a dissipative system. 
What have we constructed it for? First of all, for solving the Cauchy problem, 
in order to separate motions. This means that the Cauchy problem is divided 
in the following two subproblems: 

- Reconstruct the “fast” motion from the initial conditions to the slow 

invariant manifold ( the initial layer problem). 

- Solve the Cauchy problem for the “slow” motions on the manifold. 

Thus, solving the Cauchy problem becomes easier (and in some compli¬ 
cated cases it just becomes possible). 

Let us stress here that for any sufficiently reliable solution of the Cauchy 
problem one must solve not only the reduced Cauchy problem for the slow 
motion, but also the initial layer problem for fast motions. 

While solving the latter problem it was found to be surprisingly effective 
to use piece-wise linear approximations with smoothing or even without it 
[26,27]. This method was used for the Boltzman equation. 

There exists a different way to model the initial layer in kinetics prob¬ 
lems: it is the route of model equations. For example, the Bhatnagar-Gross- 
Krook (BGK) equation [116] is the simplest model for the Boltzmann equa¬ 
tion. It describes relaxation into a small neighborhood of the local Maxwell 
distribution. There are many types and hierarchies of the model equations 
[22,112, 116, 117, 166]. The principal idea of any model equation is to re¬ 
place the fast processes by a simple relaxation term. As a rule, it has a form 
dx/dt = ... — (x — x s i(x))/t, where x s i(x ) is a point of the approximate slow 
manifold. Such form is used in the BGK-equation, or in the quasi-equilibrium 
models [117]. It also can take a gradient form, like in the gradient mod¬ 
els [22,166]. These simplifications not only allows to study the fast motions 
separately but it also allows to zoom in the details of the interaction of fast 
and slow motions in the vicinity of the slow manifold. 

What concerns solving the Cauchy problem for the “slow” motions, this 
is the basic problem of the hydrodynamics, of the gas dynamics (if the ini¬ 
tial “big” systems describes kinetics of a gas or a fluid), etc. Here invariant 
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manifold methods provide equations for a further study. However, even a 
preliminary consideration of the practical aspects of these studies shows a 
definite shortcoming. In practice, obtained equations are exploited not only 
for “closed” systems. The initial equations (3.1) describe a dissipative sys¬ 
tem that approaches the equilibrium. The equations of slow motion describe 
dissipative system too. Then these equations are supplied with various forces 
and flows, and after that they describe systems with more or less complex 
dynamics. 

Because of this, there is a different answer to our question, what have 
we constructed the invariant manifold for? First of all, in order to construct 
models of open system dynamics in the neighborhood of the slow manifold. 
Various approaches to this modeling are described in the following subsec¬ 
tions. 

13.2 Slow Dynamics in Open Systems. 

Zero-Order Approximation 

and the Thermodynamic Projector 

Let the initial dissipative system (3.1), 

da: tv \ t t 

— = J(x), x e U , 

be “spoiled” by an additional term (“external vector field” J ex (x. t)): 
dx 

— = J(x) + J ex (x,t),x C U . (13.1) 

For this driven system the entropy does not increase everywhere. In the 
system (13.1) various nontrivial dynamic effects become possible, such as 
a non-uniqueness of stationary states, auto-oscillations, etc. The “inertial 
manifold” effect is well-known: solutions of (13.1) approach some relatively 
low-dimensional manifold on which all the non-trivial dynamics takes place 
[173,317,318]. This “inertial manifold” can have a finite dimension even for 
infinite-dimensional systems, for example, for the “reaction+diffusion” sys¬ 
tems [334]. 

In the theory of nonlinear control of partial differential equations systems 
a strategy based on the approximate inertial manifolds [342] is suggested to 
facilitate the construction of finite-dimensional systems of ordinary differen¬ 
tial equations (ODE), whose solutions can be arbitrarily close to the solutions 
of the infinite-dimensional system [344]. 

It is natural to expect that the inertial manifold of the system (13.1) is 
located somewhere close to the slow manifold of the initial dissipative system 
(3.1). This hypothesis has the following motivation. Suppose that the vector 
field J ex (x,t) is sufficiently small. Let us introduce, for example, a small 
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parameter 5 > 0, and consider sJ ex (x,t ) instead of J ex (x,t). Let us assume 
that for the system (3.1) a separation of motions into “slow” and “fast” takes 
place. In that case, there exists such an interval of positive e that sJ ex (x,t) 
is comparable to J only in a small neighborhood of the given slow manifold 
of the system (3.1). Outside this neighborhood, sJ ex (x,t) is negligibly small 
in comparison with J and its influence on the motion is negligible. For this 
statement to be true, it is important that the system (3.1) is dissipative and 
every solution comes in finite time to a small neighborhood of the given slow 
manifold. 

Precisely this perspective on the system (13.1) allows to exploit slow in¬ 
variant manifolds constructed for the dissipative system (3.1) as the ansatz 
and the zero-order approximation in a construction of the inertial manifold 
of the open system (13.1). In the zero-order approximation, the right part of 
the equation (13.1) is simply projected onto the tangent space of the slow 
manifold. 

The choice of the projector is determined by the motion separation which 
was described above, because the fast component of the vector field (13.1) is 
taken from the dissipative system (3.1). A projector which is suitable for all 
dissipative systems with the given entropy function is unique. It is constructed 
in the following way (detailed consideration was given above in Chap. 5 and 
in [10]). Let a point x G U be defined and some vector space T, on which one 
needs to construct a projection (T is the tangent space to the slow manifold 
at the point x). We introduce the entropic scalar product (\) x : 

(a\b) x = -(a,D 2 x S(b)). (13.2) 

Let us consider To, a subspace of T, which is annulled by the differential 
of S at the point x 

T 0 = {a G T\D x S(a) = 0} . (13.3) 

Suppose 1 that To 7^ T. Let e g G T, e g _L To with respect to the entropic 
scalar product (|) x , and D x S(e g ) = 1. These conditions uniquely define vector 
the e g . 

The projector onto T is defined by the formula 

P(J)=P 0 (J) + e g D x S(J) (13.4) 

where Po is the orthogonal projector onto To with respect to the entropic 
scalar product (|) x . For example, if T is a finite-dimensional space, then the 
projector (13.4) is constructed in the following way. Let ei,..., e n be a basis 
in T, and for definiteness, D x S(e 1 ) 7 ^ 0. 

(1) Let us construct a system of vectors 

bi = e i+ i - Ajei, (i = 1,..., n - 1) , (13.5) 


1 If To = T, then the thermodynamic projector is the orthogonal projector on T 

with respect to the entropic scalar product (\} x . 
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where = D x S(e i+ i)/D x S(e i), and hence D x S(bi) = 0. Thus, {fri }™ -1 
is a basis in To. 

( 2 ) Let us orthogonalize with respect to the entropic scalar product 

(\) x (3.1). We thus derived an orthonormal with respect to (\) x basis 
{fhYr 1 m T 0 . 

(3) We find e g G T from the conditions: 

(e g | Qi) x = 0, (i = 1 ,... ,n - 1 ),D x S(e g ) = 1 . (13.6) 

and, finally we get 

n—1 

P{J) = Y,9i(9i I J)x + e g D x S(J) . (13.7) 

i= 1 

If D X S(T ) = 0, then the projector P is simply the orthogonal projector with 
respect to the (1)^ scalar product. This happens if x is the point of the global 
maximum of entropy (equilibrium). Then 

n 

P(J) = (9i\9j) = Yj • (13.8) 

Remark. In applications, equation (3.1) often has additional linear balance 
constraints (conservation laws) such as numbers of particles, momentum, 
energy, etc. When solving the closed dissipative system (3.1), we simply fix 
the balance values and consider the dynamics of (3.1) on the corresponding 
affine balance subspace. 

For driven system (13.1) the conservation laws can be violated by external 
flows and fields. Because of this, for the open system (13.1) the natural bal¬ 
ance subspace includes the balance subspace of (3.1) with different balance 
values. For every set of balance values there is a corresponding equilibrium. 
Slow invariant manifold of the dissipative systems that is applied to the de¬ 
scription of the driven systems (13.1) is usually the union of slow manifolds 
for all possible balance values. The equilibrium of the dissipative closed sys¬ 
tem corresponds to the entropy maximum given the balance values are fixed. 
In the phase space of the driven system (13.1) the entropy gradient in the 
equilibrium points of the system (3.1) is not necessarily equal to zero. 

In particular, for the Boltzmann entropy in the local finite-dimensional 
case one gets the thermodynamic projector in the following form. 

s = - j f(v)Qn(f(v)) - 1 ) dv , 

DfS(J) = — j J(v)\nf(v)dv , 

(i> I V)f = - D jS(<fi)) = J 

p (J) ~Y 9i ( v ) J ~ ^ ~ 6g ^ J J ( v ) ln /( v ) dv > ( 13 - 9 ) 
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where gi(v) and e g (v) are constructed according to the scheme described 
above, 


r 9_MiM d V - S .. 

J f(v) 

J 9i{v) lnf(v)dv = 0 , 

J 9i( v ) e g( v ) dv = 0 , 

J e g (v)\n f(v) dv = 1 . 


(13.10) 

(13.11) 

(13.12) 

(13.13) 


If for all g G T we have f g(v) lnf(v) dv = 0, then the projector P is 
defined as the orthogonal projector with respect to the (|)/ scalar product. 


13.3 Slow Dynamics in Open Systems. 
First-Order Approximation 


The thermodynamic projector (13.4) defines the duality of slow and fast 
motions: if T is the tangent space of the slow manifold, then T = imP, and 
kerP is the plane of fast motions. Let us denote by P x the projector at a 
point x of a given slow manifold. 

The vector field J ex (x,t ) can be decomposed in two components: 


Jex(xp) = P x Jex(x,t) + (1 - P x )J ex (x,t ) . (13.14) 


Let us denote J exs = P x Jex > Jexf = (1 — P x )Jex • The slow component 
Jexs gives a correction to the motion along the slow manifold. This is a zero- 
order approximation. The “fast” component shifts the slow manifold in the 
fast motions plane. This shift changes P x J ex accordingly. Consideration of 
this effect gives a first-order approximation. In order to find it, let us rewrite 
the invariance equation taking J ex into account: 

/ (1 - P x )(J(x + Sx ) +eJ ex {x,t)) = 0 ; 1t; \ 

1 P x Sx = 0 . 


The first iteration of the Newton method subject to incomplete lineariza¬ 
tion gives: 


f (1 - P x ){D x J(5x) +eJ ex (x,t)) = 0 ; 
\ P x $x = 0 . 


(13.16) 


(1 - P X )D X J{ 1 - P x )J{Sx) = -eJ ex (x,t) . (13.17) 


Thus, we have derived a linear equation in the space kerP^. The operator 
(1 — P X )D X J(1 — P x ) is defined in this space. 
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Taking into account of the self-adjoint linearization instead of the opera¬ 
tor D X J (see Chap. 7) considerably simplifies solving and studying equation 

(13.17) . It is necessary to take into account here that the projector P x is a 
sum of the orthogonal projector with respect to the entropic scalar product 
(|)a; and a projector of rank one. 

Assume that the first-order approximation equation (13.17) has been 
solved and the following function is found: 

5 lX (x,eJ exf ) = -[(1 - P X )D X J( 1 - P x )]- 1 £J exf , (13.18) 

where D X J is either the differential of J or symmetrized differential of J 

(7.17) . 

Let x be a point on the initial slow manifold. At the point x + 5x(x, sJ ex /) 
the right-hand side of equation (13.1) in the first-order approximation is given 
by 

J(x) + eJ ex (x,t) + D x J(6x(x,eJ exf )) . (13.19) 

Due to the first-order approximation (13.19), the motion projected onto 
the manifold is given by the following equation 

dix 

= P x (J(x)+eJ ex (x,t) + D x J(6x(x,eJ exf (x,t)))) . (13.20) 

Note that in equation (13.20), the vector field J{pc) enters only in the form 
of projection, P x J(x). For the invariant slow manifold it holds P x J(x ) = J(x), 
but actually we always deal with approximately invariant manifolds, hence, 
it is necessarily to use the projection P X J instead of J in (13.20). 

Remark. The notion “projection of a point onto the manifold” needs to 
be specified. For every point x of the slow invariant manifold Q there are 
defined both the thermodynamic projector P x (13.4) and the fast motions 
plane ker P x . Let us define a projector 77 of some neighborhood of motion 
onto motion in the following way: 

n(z) = x 1 if P x {z — x) = 0 . (13.21) 

Qualitatively, it means that z, after all fast motions were completed, comes 
into a small neighborhood of x. The operation (13.4) is defined uniquely in 
some small neighborhood of the manifold motion. 

A derivation of slow motion equations requires not only an assumption 
that sJ ex is small but it must be slow as well: ^( £J ex ) must be small too. 

One can get further approximations for slow motions of the system (13.1), 
taking into account the time derivatives of J ex . This approach is considered in 
a more detail in the following Example for a particularly interesting driven 
system of dilute polymeric solutions. A short description of the scheme is 
given in the next section. That is an alternative to the using the projection 
operators methods [194]. 
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13.4 Beyond the First-Order Approximation: 
Higher-Order Dynamic Corrections, 

Stability Loss and Invariant Manifold Explosion 

Let us pose formally the invariance problem for the driven system (13.1) in 
the neighborhood of the slow manifold Q of the initial (dissipative) system. 

Let for a given neighborhood of 12 an operator 77 (13.21) be defined. One 
needs to define the function Sx(x ,...) =» 5x(x, J ex , J ex , J ex ,...), x E i?, with 
the following properties: 

P x (5x(x 1 ...)) = 0 , 

J(x + 5x(x , ...)) + Jex{% + 5x(x , . . .), t) 

oo 

= x s i + D x 5x(x,.. .)x si + Vd a„)6x(x, .. .) J e ( " +1) , (13.22) 

< ■* d ex 

n =0 


where 

d n J 

Xsi = P x (J(x + Sx(x ,...)) + J ex (x + 6x(x,...),t)), j e ( " } = —j^ 
D ( n)Sx(x ,...) is a partial differential of the function 

J ex 


dx{x , Jext Jex-> Jex-> • • • •> * • •) 


with respect to the variable J^ x \ One can rewrite equations (13.22) in the 
following form: 


(1 P x D X dx(x ^ • • •))('! (x T dx(x^ ...))-)- Jexix T dx(x ^.. .),£)) 

oo 

= V^ j( n)fe(x,...)J^ +1) . (13.23) 

^ ^ ex 

n=0 

For solving (13.23) one can use iterations method and also take into ac¬ 
count smallness considerations. The series in the right hand side of equation 
(13.23) can be rewritten as 


k-i 

R.H.S. = V e n+1 D tW 5x(x, ...) J e ( ” +1) (13.24) 

< ^ Jex 

n=0 

at the kth iteration, considering the terms only to order less than k. The first 
iteration equation was solved in the previous section. On the second iteration 
one gets the following equation: 


(1 Px Dx$ix{x y Jex)) {J{x + 8\x(x, J e x)) 

D z J (z^)\ z=x-\-5ix(x,J ex ) ’ (d^X 8\x{x •> Jex )) T Jex) 

— D j ex 5\x{x, Jex) Jex • 


(13.25) 
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This is a linear equation with respect to S 2 X. The solution S 2 x(x, J ex , Jex) 
depends linearly on J ex , but non-linearly on J ex . Let us remind that the first 
iteration equation solution depends linearly on J ex . 

In all these iteration equations the field J ex and its derivatives are included 
in the formulas as if they were functions of time t only. Indeed, for any solution 
x(t) of the equations (13.1) J ex (x,t ) can be substituted for J ex (x(t),t). The 
function x(t) will be a solution of the system (13.1) in which J ex (x,t ) is 
substituted for J ex (t ) in this way. 

However, in order to obtain the macroscopic equations (13.20) one must 
return to J ex {x,t). For the first iteration such return is quite simple as one 
can see from (13.19). There J ex (x, t) is calculated in points of the initial slow 
manifold. In the general case, suppose that Sx = Sx(x, J ex , j ex , ..., J^x) has 
been found. The equations for x (13.20) have the following form: 

dx 

= P x {J{x + Sx) + Jex{% + Sx,t)) . (13.26) 

In these equations the shift Sx must be a function of x and t (or a function 
of x,£,<a, where a are external fields, see example below. One calculates the 
shift 5x(x, t ) using the following equation: 

Jex = Jex(% T Sx{x, J e x-> Jexi • • • ? Jex) 5 * (13.27) 

It can be solved, for example, by the iterative method, taking J ex o = 

Jex (%? t) • 

Jex(n+ 1) Jex T Sx{x, J ex ( n )j ^eaj(n) ? • • • 5 Jex(n)) P) ' (13.28) 

We hope that using J ex in the equations (13.27) and (13.28) both as a 
variable and as a symbol of an unknown function J ex (x,t ) will not lead to a 
confusion. 

In all the constructions introduced above it was assumed that Sx is suffi¬ 
ciently small and the driven system (13.1) will not deviate too far from the 
slow invariant manifold of the initial system. However, a stability loss is possi¬ 
ble: solutions of the equation (13.1) can deviate arbitrarily far if the strength 
of the perturbations exceeds a certain level. The invariant manifold can loose 
it’s stability. Qualitatively, this effect of invariant manifold explosion can be 
represented as follows. 

Suppose that J ex includes the parameter 6: one has sJ ex in the equation 
(13.1). When e is small, the system’s motions are located in a small neigh¬ 
borhood of the initial manifold. This neighborhood grows monotonically with 
increase of 6, but after some Eq a sudden change happens (“explosion”) and 
the neighborhood, in which the motion takes place, becomes significantly 
wider at e > Eq than at e < eq. The stability loss is not necessarily associated 
with the invariance loss. In the last example to this chapter it is shown how 
the invariant manifold (which is at the same time the quasiequilibrium man¬ 
ifold in this example) can loose its stability. This “explosion” of the invariant 
manifold leads to essential physical consequences. 
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13.5 Example: The Universal Limit in Dynamics 
of Dilute Polymeric Solutions 

The method of invariant manifold is developed for a derivation of reduced 
description in kinetic equations of dilute polymeric solutions. It is demon¬ 
strated that this reduced description becomes universal in the limit of small 
Deborah and Weissenberg numbers, and it is represented by the (revised) 
Oldroyd 8 constants constitutive equation for the polymeric stress tensor. 
Coefficients of this constitutive equation are expressed in terms of the mi¬ 
croscopic parameters. A systematic procedure of corrections to the revised 
Oldroyd 8 constants equations is developed. Results are tested with simple 
flow situations. 

Kinetic equations arising in the theory of polymer dynamics constitute a 
wide class of microscopic models of complex fluids. Same as in any branch of 
kinetic theory, the problem of reduced description becomes actual as soon as 
the kinetic equation is established. However, in spite of an enormous amount 
of work in the field of polymer dynamics [151-153,354,364], this problem 
remains less studied as compared to other classical kinetic equations. 

It is the purpose of this section to suggest a systematic approach to the 
problem of reduced description for kinetic models of polymeric fluids. First, 
we would like to specify our motivation by comparing the problem of the 
reduced description for that case with a similar problem in the familiar case 
of the rarefied gas obeying the classical Boltzmann kinetic equation [70,112]. 

The problem of reduced description begins with establishing a set of slow 
variables. For the Boltzmann equation, this set is represented by five hydrody¬ 
namic fields (density, momentum and energy) which are low-order moments 
of the distribution function, and which are conserved quantities of the dissi¬ 
pation process due to particle’s collisions. The reduced description is a closed 
system of equations for these fields. One starts with the manifold of local 
equilibrium distribution functions (local Maxwellians), and finds a correction 
by the Chapman-Enskog method [70]. The resulting reduced description (the 
compressible Navier-Stokes hydrodynamic equations) is universal in the sense 
that the form of equations does not depend on details of particle’s interac¬ 
tion whereas the latter shows up explicitly only in the transport coefficients 
(viscosity, temperature conductivity, etc.). 

Coming back to the complex fluids, we shall consider the case of dilute 
polymer solutions represented by dumbbell models studied below. Two obsta¬ 
cles preclude an application of the traditional techniques. First, the question 
which variables should be regarded as slow is at least less evident because 
the dissipative dynamics in the dumbbell models has no nontrivial conserva¬ 
tion laws as compared to the Boltzmann case. Consequently, a priori, there 
are no distinguished manifolds of distribution functions like the local equilib¬ 
ria which can be regarded as a starting point. Second, while the Boltzmann 
kinetic equation provides a self-consistend closed description, the dumbbell 
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kinetic equations are coupled to the hydrodynamic equations. This coupling 
manifests itself as an external flux in the kinetic equation. 

The distinguished macroscopic variable associated with the polymer ki¬ 
netic equations is the polymeric stress tensor [151,364]. This variable is not 
a conserved quantity but nevertheless it should be treated as a relevant slow 
variable because it actually contributes to the macroscopic (hydrodynamic) 
equations. Equations for the stress tensor are known as the constitutive equa¬ 
tions, and the problem of reduced description for the dumbbell models con¬ 
sists in deriving such equations from the kinetic equation. 

Our approach is based on the method of invariant manifold [11], modified 
for systems coupled with external fields. This method suggests constructing 
invariant sets (or manifolds) of distribution functions that represent the as¬ 
ymptotic states of the slow evolution of the kinetic system. In the case of 
dumbbell models, the reduced description is produced by equations which 
constitute stress-strain relations, and two physical requirements are met by 
our approach: The first is the principle of frame-indifference with respect to 
any time-dependent reference frame. This principle requires that the result¬ 
ing equations for the stresses contain only frame-indifferent quantities. For 
example, the frame-dependent vorticity tensor should not show up in these 
equations unless being presented in the frame-indifferent combinations with 
another tensors. The second principle is the thermodynamic stability'. In the 
absence of the flow, the constitutive model should be purely dissipative, in 
other words, it should describe the relaxation of the stresses to their equilib¬ 
rium values. 

The physical picture addressed below takes into account two assumptions: 
(i) In the absence of the flow, deviations from the equilibrium are small. Then 
the invariant manifold is represented by eigenvectors corresponding to the 
slowest relaxation modes, (ii). When the external flow is taken into account, 
it is assumed to cause a small deformation of the invariant manifolds of the 
purely dissipative dynamics. Two characteristic parameters are necessary to 
describe this deformation. The first is the characteristic time variation of the 
external field. The second is the characteristic intensity of the external field. 
For dumbbell models, the first parameter is associated with the conventional 
Deborah number while the second one is usually called the Weissenberg num¬ 
ber. An iteration approach which involves these parameters is developed. 

The two main results of the study are as follows: First, the lowest-order 
constitutive equations with respect to the characteristic parameters men¬ 
tioned above has the form of the revised phenomenological Oldroyd 8 con¬ 
stants model This result is interpreted as the macroscopic limit of the mi¬ 
croscopic dumbbell dynamics whenever the rate of the strain is low, and the 
Deborah number is small. This limit is valid generically, in the absence or in 
the presence of the hydrodynamic interaction, and for the arbitrary nonlinear 
elastic force. The phenomenological constants of the Oldroyd model are ex¬ 
pressed in a closed form in terms of the microscopic parameters of the model. 
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The universality of this limit is similar to that of the Navier-Stokes equations 
which are the macroscopic limit of the Boltzmann equation at small Knudsen 
numbers for arbitrary hard-core molecular interactions. The test calculation 
for the nonlinear FENE force demonstrates a good quantitative agreement of 
the constitutive equations with solutions to the microscopic kinetic equation 
within the domain of their validity. 

The second result is a regular procedure of finding corrections to the zero- 
order model. These corrections extend the model into the domain of higher 
strain rates, and to flows which alternate faster in time. Same as in the zero- 
order approximation, the higher-order corrections are linear in the stresses, 
while their dependence on the gradients of the flow velocity and its time 
derivatives becomes highly nonlinear. 

The section is organized as follows: For the sake of completeness, we 
present the nonlinear dumbbell kinetic models in the next subsection, “The 
problem of reduced description in polymer dynamics”. In the section, “The 
method of invariant manifold for weakly driven systems”, we describe in de¬ 
tails our approach to the derivation of macroscopic equations for an abstract 
kinetic equation coupled to external fields. This derivation is applied to the 
dumbbell models in the section, “Constitutive equations”. The zero-order 
constitutive equation is derived and discussed in detail in this section, as well 
as the structure of the first correction. Tests of the zero-order constitutive 
equation for simple flow problems are given in the section, “Tests on the 
FENE dumbbell model”. 

13.5.1 The Problem of Reduced Description in Polymer Dynamics 
Elastic Dumbbell Models 

The elastic dumbbell model is the simplest microscopic model of polymer 
solutions [151]. It dumbbell reflects the two basic features of the real-world 
macromolecules to be orientable and stretchable by a flowing solvent. The 
polymeric solution is represented by a set of identical elastic dumbbells placed 
in an isothermal incompressible fluid. In this example we adopt notations 
used in kinetic theory of polymer dynamics [151]. Let Q be the connector 
vector between the beads of a dumbbell, and Q, t) be the configuration 
distribution function which depends on the location in the space x at time 
t. We assume that dumbbells are distributed uniformly, and consider the 
normalization, f &(x,Q,t)dQ = 1. The Brownian motion of beads in the 
physical space causes a diffusion in the phase space described by the Fokker- 
Planck equation (FPE) [151]: 



(13.29) 


Here, D/D t = d/dt + v • V is the substantional derivative, V is the spatial 
gradient, k(x,t ) = (Vv)^ is the gradient of the velocity of the solvent v, f 
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denotes transposition of tensors, D is the dimensionless diffusion matrix, k b is 
the Boltzmann constant, T is the temperature, £ is the dimensional coefficient 
characterizing a friction exerted on beads moving through solvent media (the 
friction coefficient [151,152]), and F = d(j)/dQ is the elastic spring force 
defined by the potential (j). We consider forces of the form F = H /(Q 2 )Q, 
where f(Q 2 ) is a dimensionless function of the variable Q 2 = Q Q, and H 
is the dimensional constant. Incompressibility of solvent implies JV ku = 0. 

Let us introduce a time dimensional constant 

Ar “4 H' 

which coincides with a characteristic relaxation time of dumbbell configura¬ 
tion in the case when the force F is linear: f(Q 2 ) = 1. It proves convenient 
to rewrite the FPE (13.29) in the dimensionless form: 


~Dt 


_d_ 

dQ 


- - d 

k • QiP + — D 

dQ 


( -btf' + F!?- 
VdQ 


(13.30) 


Various dimensionless quantities used are: Q = (iL/&B^) 1//2 Q, D/Dt = 
d/dt + v-V, t = t/ A r is the dimensionless time, V = A r V is the reduced space 
gradient, and k = k\ r = (Vv)^ is the dimensionless tensor of the gradients of 
the velocity. In the sequel, only dimensionless quantities Q and F are used, 
and we keep notations Q and F for them for the sake of simplicity. 

The quantity of interest is the stress tensor introduced by Kramers [151]: 


r = —147 + nk B T{l - {FQ )) , (13.31) 

where 14 is the viscosity of the solvent, 7 = k + is the rate-of-strain 
tensor, n is the concentration of polymer molecules, and the angle brackets 
stand for the averaging with the distribution function \P: (•) = J •ty(Q) dQ. 
The tensor 

r p = nk B T{ 1 - {FQ)) (13.32) 

gives a contribution to the stresses caused by the presence of polymer mole¬ 
cules. 

The stress tensor is required in order to write down a closed system of 
hydrodynamic equations: 

Dr? 

_ = -p- 1 Vp-V-T[^] . (13.33) 

Here p is the pressure, and p = p s + p p is the mass density of the solution 
where p s is the solvent, and p p is the polymeric contributions. 

Several models of the elastic force are known in the literature. The 
Hookean law is relevant to small perturbations of the equilibrium configu¬ 
ration of the macromolecule: 
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F = Q. 


(13.34) 


In that case, the differential equation for r is easily derived from the kinetic 
equation, and is the well known Oldroyd-B constitutive model [151]. 

Another model, the Finitely Extendible Nonlinear Elastic (FENE) force 
law [355], was derived as an approximation to the inverse Langevin force 
law [151] for a more realistic description of the elongation of a polymeric 
molecule in a solvent: 


F = 


Q 


(13.35) 


i - q 2 /qI ' 

This force law takes into account the nonlinear stiffness and the finite ex- 
tendibility of dumbbells, where Q 0 is the maximal extendibility. 

The properties of the diffusion matrix are important for both the micro¬ 
scopic and the macroscopic behavior. The isotropic diffusion is represented 
by the simplest diffusion matrix 


D i = 



(13.36) 


Here 1 is the unit matrix. When the hydrodynamic interaction between the 
beads is taken into account, this results in an anisotropic contribution to 
the diffusion matrix (13.36). The original form of this contribution is the 
Oseen-Burgers tensor D h [356,357]: 


D = D] kD h , 




(13.37) 


where 


k, = 


H \ 1/2 £ 

k^T ) 167 tv s 


Several modifications of the Oseen-Burgers tensor can be found in the liter¬ 
ature (the Rotne-Prager-Yamakawa tensor [358,359]), but here we consider 
only the classical version. 


Properties of the Fokker—Planck Operator 

Let us review some of the properties of the Fokker-Planck operator J in the 
right hand side of (13.30) relevant to what will follow. This operator can be 
written as J = Jd + Jh, and it represents two processes. 

The first term, Jd, is the dissipative part, 

(13 - 38> 

This part is responsible for the diffusion and friction which affect internal con¬ 
figurations of dumbbells, and it drives the system to the unique equilibrium 
state, 
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^eq = C -1 exp (~<fi(Q 2 )) , 

where c = f exp(— <fi) d Q is the normalization constant. 

The second part, Jh, describes the hydrodynamic drag of the beads in the 
flowing solvent: 

Jh = -Tk-Q. (13.39) 

The dissipative nature of the operator Jd is reflected by its spectrum. We 
assume that this spectrum consists of real-valued nonpositive eigenvalues, 
and that the zero eigenvalue is not degenerated. In the sequel, the following 
scalar product will be useful: 

(9 , h) B = j 1 gh d Q . 

The operator Jd is symmetric and nonpositive definite in this scalar product: 

(Jdg,h)s = {g,Jdh)a, and ( Jdg,g) s < o . (13.40) 

Since 

(■ Jd9,9)a = - j &^{dg/dQ) ■ i^q D ■ ( dg/dQ) d Q , 

the above inequality is valid if the diffusion matrix D is positive semidefinite. 
This happens if D = D\ (13.36) but is not generally valid in the presence of 
the hydrodynamic interaction (13.37). Let us split the operator Jd according 
to the splitting of the diffusion matrix D : 

Jd = J\~ kJ *> where J !\ H = 9/dQ ■ £>ih • {d/dQ + F ) . 

Both the operators ./,( and ./// have nondegenerated eigenvalue 0 which cor- 
responds to their common eigenfunction !^ eq : J d ’ ^ eq = 0, while the rest of 
the spectrum of both operators belongs to the nonpositive real semi-axis. 
Then the spectrum of the operator Jd = J^ — remains nonpositive for 
sufficiently small values of the parameter k. The spectral properties of both 
operators J d H depend only on the choice of the spring force F. Thus, in the 
sequel we assume that the hydrodynamic interaction parameter k is suffi¬ 
ciently small so that the thermodynamic stability property (13.40) holds. 

We note that the scalar product (•, •) s coincides with the second differ¬ 
ential D^S of an entropy functional S[\P]: 



where the entropy has the form: 

dQ =~(' n (id)- 


(13.41) 
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The entropy S grows in the course of dissipation: 

D*S[J d &] > 0 . 

This inequality, similar to inequality (13.40), is satisfied for sufficiently small 
n. Symmetry and nonpositiveness of operator J d in the scalar product defined 
by the second differential of the entropy is a common property of linear 
dissipative systems. 

Statement of the Problem 

Given the kinetic equation (13.29), we aim at deriving differential equations 
for the stress tensor r (13.31). The latter includes the moments (FQ) = 
f FQ& dQ. 

In general, when the diffusion matrix is non-isotropic and/or the spring 
force is nonlinear, closed equations for these moments are not available, and 
approximations are required. With this, any derivation should be consistent 
with the three requirements: 

(i) Dissipativity or thermodynamic stability: The macroscopic dynamics 
should be dissipative in the absence of the flow. 

(ii) Slowness : The macroscopic equations should represent the slow degrees 
of freedom of the kinetic equation. 

(iii) Material frame indifference: The form of equations for the stresses should 
be invariant with respect to the Eucluidian, time dependent transforma¬ 
tions of the reference frame [151,360]. 

While these three requirements should be met by any approximate deriva¬ 
tion, the validity of our approach will be restricted by two additional assump¬ 
tions: 

(a) Let us denote 9\ the inertial time of the flow, which we define via the 
characteristic value of the gradient of the flow velocity: 0\ = |Vv| _1 , and O 2 
the characteristic time of the variation of the flow velocity. We assume that 
the characteristic relaxation time of the molecular configuration 9 r is small 
as compared to both the characteristic times 6 \ and O 2 : 

6 r < 61 and 6 r < 62 • (13.42) 

(b) In the absence of the flow, the initial deviation of the distribution 
function from the equilibrium is small so that the linear approximation is 
valid. 

While the assumption (b) is merely of a technical nature, and it is in¬ 
tended to simplify the treatment of the dissipative part of the Fokker-Planck 
operator (13.38) for elastic forces of a complicated form, the assumption (a) is 
crucial for taking into account the flow in an adequate way. We have assumed 
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that the two parameters characterizing the composed system ‘relaxing poly¬ 
mer configuration + flowing solvent’ should be small: These two parameters 
are: 

ei = o r /e i < i , 5 2 = e v /e 2 < i . (13.43) 

The characteristic relaxation time of the polymeric configuration is de¬ 
fined via the coefficient A r : 0 T = cA r , where c is some positive dimension¬ 
less constant which is estimated by the absolute value of the lowest nonzero 
eigenvalue of the operator J&. The first parameter 51 is usually termed the 
Weissenberg number while the second one e 2 is the Deborah number ([361], 
Sect. 7.2). 

13.5.2 The Method of Invariant Manifold 
for Weakly Driven Systems 

The Newton Iteration Scheme 

In this section we introduce an extension of the method of invariant manifold 
[11] onto systems coupled with external fields. We consider a class of dynamic 
systems of the form 

— = J d * + J ex (a)!f , (13.44) 

where Jd is a linear operator representing the dissipative part of the dynamic 
vector field, while J ex (&) is a linear operator which represents an external 
flux and depends on a set of external fields a = {oq,... , a^}. Parameters 
a are either known functions of the time, a = <a(£), or they obey a set of 
equations, 

^ = <?(!?, a). (13.45) 

Without any restriction, parameters a are adjusted in such a way that 
J ex (a = 0) = 0. Kinetic equation (13.30) has the form (13.44), and gen¬ 
eral results of this section will be applied to the dumbbell models below in a 
straightforward way. 

We assume that the vector field has the same dissipative properties as 
the Fokker-Planck operator (13.38). Namely there exists the globally convex 
entropy function S which obeys: D&S[Jd&] > 0, and the operator Jd is 
symmetric and nonpositive in the scalar product (•, •) s defined by the second 
differential of the entropy: (g,h) s = —D#S[g,h\. Thus, the vector field 
drives the system irreversibly to the unique equilibrium state lF eq . 

We consider a set of n real-valued functionals, M*[\P] (macroscopic vari¬ 
ables), in the phase space T of the system (13.44). A macroscopic description 
is obtained once we have derived a closed set of equations for the variables 
M*. 

Our approach is based on constructing a relevant invariant manifold in 
the phase space T. This manifold is thought as a finite-parametric set of 
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solutions ^(M) to equations (13.44) which depends on time implicitly via 
the n variables The latter may differ from the macroscopic variables 

M*. For systems with external fluxes (13.44), we assume that the invariant 
manifold depends also on the parameters <a, and on their time derivatives 
taken to arbitrary order: ^(M, A), where A = {a, ...} is the set of time 

derivatives = d k a/dt k . It is convenient to consider time derivatives of a 
as independent parameters. This assumption is important because then we 
do not need an explicit form of (13.45) in the course of construction of the 
invariant manifold. 

By the definition, the dynamic invariance postulates the equality of the 
“macroscopic” and the “microscopic” time derivatives: 


JV(M,A) = 


A9 ?P(M, A) d Mi 
^ ~dMi dt~ 


ST' ST' d\P(M, A) (n+l) 

2 -^ 2 -^ o (n) a 0 


(13.46) 


where J = Jd + J ex (<a). The time derivatives of the macroscopic variables, 
dMi/dt , are calculated as follows: 


d Mj 
d t 


D^Mi[M{M,A)] , 


(13.47) 


where D^Mi stands for differentials of the functionals Mi. 

Let us introduce the projector operator associated with the parameteri¬ 
zation of the manifold \P(M,A) by the values of the functionals M^].\ 


Pm = J2 

1=1 


d&{M, A) 

dMi 


D&Mi[*] 


(13.48) 


It projects vector fields from the phase space T onto the tangent space 
T\P(M,A) of the manifold \P(M,A). Then (13.46) is rewritten as the in¬ 
variance equation : 


oo k t'jj 

(1-P m )J*(M,A) = EEEE aj n+1) , (13.49) 

n=Oj=i da) 

which has the invariant manifolds as its solutions. 

Furthermore, we assume the following: (i). The external flux J ex (a)\P is 
small in comparison to the dissipative part Jd^, i.e. with respect to some 
norm we require: 

l|J r e*(a)tf|| « IPd^ll . 

This allows us to introduce a small parameter £i, and to replace the operator 
J ex with s\ J ex in (13.44). Parameter e\ is proportional to the characteris¬ 
tic value of the external variables a. (ii). The characteristic time 0 a of the 
variation of the external fields a is large in comparison to the characteristic 
relaxation time 0 r , and the second small parameter is 62 = 0 r /0 a <C 1. The 
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parameter £ 2 does not enter the vector field J explicitly but it shows up in 
the invariance equation. Indeed, with a substitution, q;W _> , the in¬ 

variance equation (13.46) is rewritten in a form which incorporates both the 
parameters E\ and £ 2 : 


(1 — Pm){J(1 + £l^ex}^ — £2 

i 3=1 da j 

We develop a modified Newton scheme for solution of this equation. Let us 
assume that we have some initial approximation to desired manifold P( 0 ). We 
seek the correction of the form = P( 0 ) +$ 4 . Substituting this expression 
into (13.50), we derive: 


(1 - P|?){ J d + ei J ex }*i -e 2 


=1 da 


d&i (i+i) 

-= 

W 3 


-(1 --PmV^(0) + £2 EE 




* 3 


=1 <9<a 


(?) .,(<+ 1 ) 

« a j • 


(13.51) 


Here is a projector onto tangent bundle of the manifold P( 0 ). Further, we 
neglect two terms in the left hand side of this equation, which are multiplied 
by parameters e\ and £ 2 , regarding them small in comparison to the first 
term. In the result we arrive at the equation, 


W { 


(oiu+D 


(1 - p^)j d ^ = -(1 - p$) m (0) +£2 E E * (o “i 

i j=1 da j 

For (n + l)-th iteration we obtain: 


(13.52) 


(1 - P#>) J d <F n+1 = -(1 - P$)W (n ) + £2 EE 


m 


=1 da 


00 (*+ 1 ) 

w 


(13.53) 


where P( n ) = SlLo ^ * s the approximation of n-th order and pffi is the 
projector onto its tangent bundle. 

It should be noted that deriving equations (13.52) and (13.53) we have not 
varied the projector Pm with respect to yet unknown term P n+ i, i.e. we have 
kept Pm = Pffl and have neglected the contribution from the term P n +i. 
The motivation for this action comes from the original paper [11], where 
it was shown that such modification generates iteration schemes properly 
converging to slow invariant manifold. 

In order to gain the solvability of (13.53) an additional condition is re¬ 
quired: 

P^&n+l = 0 ■ 


(13.54) 
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This condition is sufficient to provide the existence of the solution to linear 
system (13.53), while the additional restriction onto the choice of the pro¬ 
jector is required in order to guarantee the uniqueness of the solution. This 
condition is 

ker[(l - Pffi)Jd] n ker pffi = 0 . (13.55) 

Here ker denotes a null space of the corresponding operator. How this condi¬ 
tion can be met is discussed in the next subsection. 

It is natural to begin the iteration procedure (13.53) starting from the 
invariant manifold of the non-driven system. In other words, we choose the 
initial approximation ^ 0 ) as the solution of the invariance equation (13.50) 
corresponding to e\ = 0 and = 0: 

(l-PjgVd^o) =0. (13.56) 

We shall return to the question how to construct solutions to this equation 
in the subsection “Linear zero-order equations”. 

The above recurrent equations (13.53), (13.54) present the Newton method 
for the solution of invariance equation (13.50), which involves the small para¬ 
meters. A similar procedure for the Grad equations of the Boltzmann kinetic 
theory was used recently in [21]. When these parameters are not small, one 
should proceed directly with equations (13.51). 

Above, we have focused our attention on how to organize the iterations to 
construct invariant manifolds of weakly driven systems. The only question we 
have not yet answered is how to choose the projectors in iterative equations in 
a consistent way. In the next subsection we discuss the problem of derivation 
of the reduced dynamics and its relation to the problem of the choice of the 
projector. 

Projector and Reduced Dynamics 

Below we suggest the projector which is equally applicable for constructing 
invariant manifolds by the iteration method (13.53), (13.54) and for generat¬ 
ing macroscopic equations on a given manifold. 

Let us discuss the problem of constructing closed equations for macropa¬ 
rameters. Having some approximation to the invariant manifold, we never¬ 
theless deal with a non-invariant manifold and we face the problem how to 
construct the dynamics on it. If the n-dimensional manifold W is found then 
the macroscopic dynamics is induced by a projector P onto the tangent bun¬ 
dle of as follows [11]: 


d M* 
d t 


d*m; | # 


PM 


(13.57) 


In order to specify the projector we apply the two above mentioned principles: 
dissipativity and slowness. The dissipativity is required to have the unique 
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and stable equilibrium solution for macroscopic equations when the external 
fields are absent (a = 0). The slowness condition requires the induced vector 
field PJ\P to match the slow modes of the original vector field JP. 

Let us consider the parameterization of the manifold P(M) by the para¬ 
meters This parameterization generates associated projector P = Pm 

by (13.48). This leads us to look for the admissible parameterization of this 
manifold, where by admissibility we understand the concordance with the 
dissipativity and the slowness requirements. We solve the problem of the ad¬ 
missible parameterization in the following way. Let us define the functionals 
Mi i = 1 ,..., n by the set of the eigenvectors ipi of the operator J&\ 

Mi[$] = <<*,*>. , 

where Jd^i = The eigenvectors are taken as a union of 

orthonormal basises in the eigenspaces corresponding to the eigenvalues with 
smallest absolute values: 0 < |Ai| < |A 2 1 < ... < |A n |, (<Pi,(pj) s — $ij- Since 
the function P eq is the eigenvector corresponding to the eigenvalue zero, we 
have: Mi [& eq ] = (tpu&eq )s = 0 . 

The associated projector Pm, 


p M = 

i =1 


~dMi 


(‘Pi ,*)s , 


(13.58) 


generates the equations of the macroscopic dynamics in terms of the para¬ 
meters Mi\ 

dMi/dt = (<p i P M J'P) s = (PiJ^) s ■ 

Their explicit form is 


d Mi 
d t 


= XMi + (J+M)^(M)) S , 


(13.59) 


where the J+. is the adjoint to operator J ex with respect to the scalar product 

Apparently, in the absence of forcing (a = 0 ) the macroscopic equations 
dMi/dt = A iMi are thermodynamically stable. They represent the dynamics 
of the slowest eigenmodes the of the equation dP/dt = Jd^. Thus, the pro¬ 
jector (13.58) complies with the requirements of dissipativity and slowness in 
the absence the external flow. 

In order to rewrite the macroscopic equations (13.59) in terms of the 
required set of macroparameters, M*[P] = (m*,P) s , we use the formula 
(13.57) which is equivalent to the change of variables {M} —> {M*(M)}, 
M* = (m*,P(M)) s in the equations (13.59). Indeed, this is seen from the 
relation: 




PmJV 
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We have constructed the dynamics with the help of the projector Pm 
associated with the lowest eigenvectors of the operator J^. It is directly ver¬ 
ified that such projector (13.58) fulfills the condition (13.54) for arbitrary 
manifold ^ n ) = P. For this reason it is natural to use the projector (13.58) 
for both procedures, constructing the invariant manifold, and deriving the 
macroscopic equations. 

We note that the above approach to defining the dynamics via the spectral 
projector is a specification of the concept of “thermodynamic parameteriza¬ 
tion” proposed in [9,11]. 


13.5.3 Linear Zero-Order Equations 

In this section we focus our attention on the solution of the zero-order invari¬ 
ance equation (13.56). We seek the linear invariant manifold of the form 

n 

<f ( 0 )(a) = & eq + E airrii , (13.60) 

i= 1 

where cq are coordinates on this manifold. This manifold can be considered 
as an expansion of the relevant slow manifold near the equilibrium state. This 
limits the domain of validity of the manifolds (13.60) because they may be not 
positively definite. This remark indicates that nonlinear invariant manifolds 
should be considered for large deviations from the equilibrium but this goes 
beyond the scope of this Example. 

The linear n-dimensional manifold representing the slow motion for the 
linear dissipative system (13.44) is associated with the n slowest eigenmodes. 
This manifold should be built up as the linear hull of the eigenvectors tpi of 
the operator Jd, corresponding to the lower part of its spectrum. Thus we 
choose rrii = (fi. 

Dynamic equations for the macroscopic variables M* are derived in two 
steps. First, following the subsection, “Projector and reduced dynamics”, 
we parameterize the linear manifold P( 0 ) with the values of the moments 
Mi[P] = (( Pi,\P ) s • We obtain the parameterization of the manifold (13.60) in 
terms of cq = M^, 

n 

% )(M) = V'eq + 'pMiVi , 

i= 1 

The reduced dynamics in terms of variables Mi reads: 

= XiMi + (fj) s Mj + (^eq)s 5 (13.61) 

j 

where \ = (<pi, Jd^) s are eigenvalues which correspond to eigenfunctions 
<Pi- 
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Second, we switch from the variables Mi to the variables M*{M) = 
(m*,^( 0 )(M)) s in (13.61). Resulting equations for the variables M* are also 
linear: 


jkl jk 

+ )ij(J^ x ( Pj ,$ r eq)s • (13.62) 

3 

Here, AM* = M* — M* q |. is the deviation of the variable M* from its equi¬ 
librium value M* q | i? and Bij = (m*,ipj), and = A iSij. 

13.5.4 Auxiliary Formulas. 1. Approximations 
to Eigenfunctions of the Fokker—Planck Operator 

In this subsection we discuss the question how to find the lowest eigenvectors 

o 

^eq^o(Q 2 ) and ^ r eq mi(Q 2 ) QQ of the operator J& (13.38) in the classes of 

o 

functions of the form: wq(Q) and w\(Q) QQ. The results presented in this 
subsection will be used below in the subsections: “Constitutive equations” 
and “Tests on the FENE dumbbell model”. 

It is directly verified that: 


J d w 0 = GqW o , 

J d u>i QQ = (G^wi) QQ , 

where the operators G(j and G\ are given by: 

Go = Go — kH 0 , Gj = Gi - Kifi . (13.63) 

The operators Go,i and H^ i act in the space of isotropic functions (i.e. 
dependent only on Q = ( Q • Q ) 1 ^ 2 ) as follows: 

1 / F& o p r) \ 

Go= 2 \dQ* ~ fQ dQ + QdQJ ’ ^ 13 ' 64 ^ 

G ‘ = KI^- /£ 4 + 5sr 2/ )' (1 “ 5) 

H °=h{w- IQ h + hik)' (1M6) 

H ' = hiw^ IQ h + h^Q~ 2f+ ^) • (1M7) 

The following two properties of the operators Gq i are important for our 
analysis: Let us define two scalar products (•, •)o and (•, «)i: 
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(y,x )0 = {xy) e , 

(y,x) 1 = ( xyQ 4 ) e . 

Here, (•) e is the equilibrium average as defined in (13.80). For sufficiently 
small k the operators G|} and G] 1 are symmetric and nonpositive in the 
scalar products (•, »)o and (•,•)! respectively. Thus, for obtaining the de¬ 
sired eigenvectors of the operator J g we need to find the eigenfunctions m o 
and mi related to the lowest nonzero eigenvalues of the operators Gq i* 
Since we regard the parameter k small it is convenient, first, to find the 
lowest eigenfunctions #o,i of the operators Go,i and, second, to use the stan¬ 
dard perturbation technique in order to obtain raoq. For the first-order per¬ 
turbation one finds [367]: 

, 7 7 (goHoGogo)o n 

m 0 = go + Kho , ho = - go —7-r- GoH 0 go ; 

\9o,9o/o 

m 1 =g l +Kh 1 , hi = ~g 1 —^ lG ' lg1 ) 1 - G 1 g lgl . (13.68) 

<31,31)1 

For the rest of this subsection we describe one recurrent procedure for 
obtaining the functions mo and mi in a constructive way. Let us solve this 
problem by minimizing the functionals LambdaoX 


^o,i[ m o,i] 


(m 0 ,i,G}j 4 mo,i)o,i 
(mo,1, mo,1)0,1 


min , 


(13.69) 


by means of the gradient descent method. 

Let us denote eoq the eigenfunctions of the zero eigenvalues of the op¬ 
erators Gq-l, eo = 1 and e\ = 0. Let the initial approximations to the 

lowest eigenfunctions mo,i be so chosen that (rag 0 ^, eo,1)0,1 = 0. We define 
the variational derivative dAo : i/Smo : i and look for the correction in the form: 


mg = mg + (5mg , <5rag = a 


(0) _ ^0,1 

Sm 0 ,1 


(13.70) 


where scalar parameter a < 0 is found from the condition: 


3A),i[mg(a)] 

da 

In the explicit form the result reads: 


<5mg 


a 


(o) Vo) 


,1^1 


0,1 5 


where 
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^(°) _ 
^0,1 — 


x (0) _ 

A 0,l — 


! m o°f m o°i)o,i 

( m o°i’ m o°i)o,l 


y m o,i A o,i u o,i m o,i J 5 


(13.71) 


( 0 ) 

<* 0,1 = 9o,i 


9o,i = 


\ 


lm ( 0 ) 

o , \ m 0,l5 m 0,1/0,1 

9o,i 

l 


(A),l5 A),1/0; 


/rn (°) ^don //V (Uj .(UK 

\ m o,i? ^0,l m 0,1/0,1 (A),i> ^0,1 A),1/0,1 


,(°) 


( 0 ) 


v(0)\ 


//v(°) /\( 0 ) \ \ !{U) Iuk 

\^ 0 , 1 ’^ 0 , 1 / 0,1 V ( m 0,15 m 0 , 1 / 0,1 


(0) _(0)\ 


/ /\(0) /\(0)\ 

(A),l5 A),l/0,1 


With the new correction we can repeat the procedure and even¬ 

tually generate recurrence scheme. Since by the construction all iterative 
approximations remain orthogonal to the zero eigenfunctions eo,i, 

( m o n i 5 e o,i)o,i = 0 we avoid the convergence of this recurrence procedure 
to the eigenfunctions eo,i. (Note that this method resembles the relaxation 
method, Chap. 9.) 

The quantities : 


/ aM aW\ 

An) (^ 0 , 15 ^ 0 , 1 / 0,1 

0,1 lm ( n ^ m^\ 

( m 0,l 5 m 0,l /0,1 

can serve as a relative error for controlling the convergence of the iteration 
procedure (13.70). 


13.5.5 Auxiliary Formulas. 2. Integral Relations 

Let Q be a sphere in R 3 centered at the origin, or the entire space R 3 . For 
any function s(a? 2 ), where x 2 = a? • a?, a? G R 3 , and any 3x3 matrices A, R, 
C independent of a?, the following integral relations are valid: 


f s(x 2 ) xx (x°x : A) dx = — A f sx 4 da? ; 

Jo 15 Jo 

[ six 2 ) xx (xx : A)(x°x : B) da? = —— (A-B + B-A) [ sx 6 da? ; 
Jo 105 J n 

f s(x 2 ) xx (xx : A)(x°x : R)(x°x : C) da? = 

Jo 


4 

315 


{a (B : C)+ B (A : C)+ C (A : B) 


'dx . 
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13.5.6 Microscopic Derivation of Constitutive Equations 
Iteration Scheme 

In this section we apply the above developed formalism to the elastic dumb¬ 
bell model (13.30). External field variables a are the components of the 
tensor k. 

Since we aim at constructing a closed description for the stress tensor r 
(13.31) with the six independent components, the relevant manifold in the 
problem should be six-dimensional. Moreover, we allow a dependence of the 

^ M'l) 

manifold on the material derivatives of the tensor k: k = D l k/Dt l . Let 

^*(M, JC) /C = {k, k^ \ ...} be the desired manifold parameterized by the 
six variables Mi i = 1 ,... ,6 and the independent components (maximum 
Mi) Mi) 

eight for each k ) of the tensors k . Small parameters S\ and £ 2 , introduced 
in the section: “The problem of reduced description in polymer dynamics”, 
are established by (13.43). We then write the invariance equation: 

00 f)\T/ 

(1 Pm)(J d+Sl'Jh)^ — £2 ( 13 - 72 ) 

i=0 Im dk lrn 

where Pm = (d\P/dMi)D&Mi[m\ is the projector associated with chosen pa¬ 
rameterization and summation indexes /,ra run only eight independent com¬ 
ponents of tensor k. 

Following the further steps of the procedure we obtain the recurrent equa¬ 
tions: 

(1 - P$) JA +1 = -(1 - P& } )[J d + £1 Jh.]*(„) + £2 

i lm ° k lrn 

(13.73) 

P { M ] *n+ % = 0 , (13.74) 

where is the correction to the manifold \P( n ) = X^=o 

The zero-order manifold is found as the relevant solution to the equation: 

(l-P^Vd^o) =0 (13.75) 

We construct zero-order manifold ^ 0 ) in the subsection, “Zero-order consti¬ 
tutive equation”. 


The Dynamics in the General Form 

Let us assume that some approximation to invariant manifold P(a^JC) is 
found (here a = {ai,...,ae} are some coordinates on this manifold). The 
next step is the constructing of the macroscopic dynamic equations. 
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In order to comply with dissipativity and slowness by means of the recipe 
from the previous section, we need to find six lowest eigenvectors of the 
operator J&. We shall always assume in the sequel that the hydrodynamic 
interaction parameter k is small enough so that the dissipativity of J& (13.40) 
is not violated. 

Let us consider two classes of functions: C\ — {wo(Q 2 )} and C 2 = 

o 

{w 1 (Q 2 ) QQ}, where are functions of Q 2 and the notation o indicates 
the traceless part, e.g. for the dyad QQ: 

0 1 

(QQ)ij = QiQj • 

Since the sets C\ and C 2 are invariant with respect to operator Jd, i.e. J&C\ C 

Ci and JdC 2 C C 2 , and densities FQ = / QQ +(1/3)1 fQ 2 of the moments 
comprising the stress tensor r p (13.32) belong to the space Ci ® C 2 , we shall 
seek the desired eigenvectors in the classes Ci and C 2 . Namely, we intend to 
find one lowest isotropic eigenvector *F eq rao(Q 2 ) of the eigenvalue — Ao (Ao > 

o 

0) and five nonisotropic eigenvectors nriij = *F e q^i(Q 2 )(QQ)r/ corresponding 
to another eigenvalue — Ai (Ai > 0). The method of derivation and analytic 
evaluation of these eigenvalues were discussed in the subsection “Auxiliary 
formulas, 1”. For now we assume that these eigenvectors are known. 

In the next step we parameterize the given manifold Sfr by the values of 
the functionals: 

M 0 = (i'eqmo,^ = J mo&dQ , 

M= (tfeqTOi QQ+s = J mi QQ <PdQ . (13.76) 

_ O 

Once the desired parameterization lF(Mo,M,/C) is obtained, the dynamic 
equations are found as: 

+ A 0 Mo = : Q°Q)m^ (13.77) 

M[i] +Ai M = -1+ :M -^(miQ 2 ) + (qQ (^ :QQ)m' 1 ^) , 

where all averages are calculated with the distribution function IF, i.e. (•) = 
f d Q, tuq x = dmo,i(Q 2 )/d(Q 2 ) and the subscript [1] represents the upper 
convective derivative of a tensor: 

The parameters Ao,i, which are the absolute values of eigenvalues of the 
operator J^, are calculated from the formulas (for the definition of operators 
G\ and G 2 see subsection “Auxiliary formulas, 1”): 
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(fflp(jOTOo) e Q 

(m 0 mo) e 
(Q 4 miGimi) e _ 
(mimiQ 4 ) e 


(13.78) 

(13.79) 


where we have introduced the notation for the equilibrium average: 


(y)e = J^ydQ. (13.80) 

Equations for the components of the polymeric stress tensor r p (13.32) 

o 

are constructed as a change of variables {Mq,M} —> r p . The use of the 
projector P makes this operation straightforward: 


Lh-p 

Dt 


— nk^T 


/ 


FQPJP(Mq(t p , /C), M (t p ,/C),/C) d Q . 


(13.81) 


Here, the projector P is associated with the parameterization by the variables 
Mo and M: 

dP dP ° 

P= wirr(%qmo,»)s + Y] — 5 — (% q rn 1 (QQ) k i,») s . (13.82) 

dM ° ki d M kl 

We note that sometimes it is easier to make a transition to the variables 
r p after solving the equations (13.77) rather than to construct explicitly and 
solve equations in terms of r p . This allows to avoid inverting the functions 

o 

t p (Mo,M) and to deal with simpler equations. 


Zero-Order Constitutive Equation 


In this subsection we derive the closed constitutive equations based on the 
zero-order manifold ^ 0 ) found as the appropriate solution to (13.75). Follow¬ 
ing the approach described in subsection, “Linear zero-order equations”, we 
construct such a solution as the linear expansion near the equilibrium state 

o 

P eq (13.60). After parameterization by the values of the variables Mq and M 

o 

associated with the eigenvectors ^ e q^o and ^ eq mi QQ we find: 


#(0) = ^eq ( 1 + Mo 


m 0 


(m 0 m 0 ) 

With the help of the projector (13.82) 


15 ° <U mi 
— M:QQ <mimi g4) 


(13.83) 


p(°) i7 f _ 

M eq \ (TOqTOo) 


/. 


m 0 \ , 15 

(m 0 ,*) e + 


m i 


2 ( mimiQ 4 ) 


QQ : (mi QQ, •) € 


(13.84) 
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and using the formula (13.81) we obtain: 


Dtir v 


Dt 


+ A 0 trr p = a 0 


(Vij, 


O o 

T p[ 1] +Aq Tp = ^0 


Tp • 7 + 7 • Tp 


(13.85) 

■ b(T p : 7 ) + (bitvTp - b 2 nk B T )7 , 


where the constants b,, 00 are defined by the following equilibrium averages: 
_ (/m 0 Q 2 )e(m 0 TOiQ 4 TO / 1 )e 

00 {fm 0 Q 4 ) e (',ml) e 

2 (m\m 2 Q 6 ) e 


bo = - 
bi = 

b 2 = 


7 (mf<5 4 ) e 

1 (/TOlQ 4 )e 

15 ( fm 0 Q 2 ) e 

1 (/miQ 4 ) e 

15 (mimiQ 4 ) ( 


(m 0 m' 2 Q 4 ) e (m 0 m 1 Q 2 ) e 


(m\Q i ) e (mimiQ 4 ) e 
{2 {m' 2 Q 4: ) e + 5 (miQ 2 ) e } . 


(13.86) 


We remind that m' 0 1 = dmo,i/d(Q 2 ). These formulas were obtained using 
the auxiliary results from subsection “Auxiliary formulas, 2 ”. 


Revised Oldroyd 8 Constant Constitutive Equation for the Stress 

It is remarkable that when rewritten in terms of the full stresses, r = — Z 47 + 
r p , the dynamic system (13.85) takes the form: 

T + C 1 T[!] + c 3 {7 • r + T • 7 } + c 5 (trr )7 + 1 (c 6 r : 7 + c 8 trr) 

= -V {7 + C27[1] + C 47 • 7 + C 7(7 : 7) 1 } , (13.87) 

where the parameters v , c* are given by the following relationships: 

v = \v s n, m = 1 + nkBTXibi/v, , 

Cl = A r /Ai , c 2 = A r /(/iAi) , 

C 3 = —5oA r /Ao , C 4 = — 26 0 A r /(/iAi) , 

C 5 = —^( 2 bo — 3bi — 1 ) , cq = -^-(Zbo + 1 — ao) , 
oAi Ai 

° 7 = ^ — a °) ’ c 8 = — * (13.88) 

In the last two formulas we returned to the original dimensional quantities: 
time t and gradient of velocity tensor = Vr, and at the same time we kept 
the notations for the dimensional convective derivative, A[ X ] = DA/Dt — k • 

A-A k ] . 
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Note that all the parameters (13.88) are related to the entropic spring 
law / due to (13.86). Thus, the constitutive relation for the stress r (13.87) 
is fully derived from the microscopic kinetic model. 

If the constant eg were equal to zero, then (13.87) would be recognized 
as the Oldroyd 8 constant model [362], proposed by Oldroyd about 40 years 
ago on a phenomenological basis. Nonzero value of eg indicates a difference 
between A r /Ao and A r /Ai which are the relaxation times of trace trr and of 
the traceless components r of the stress tensor r. 

Higher-Order Constitutive Equations 

In this subsection we discuss some properties of corrections to the revised Ol¬ 
droyd 8 constant constitutive equation (that is, the zero-order model) (13.87). 
Let Pjff (13.84) be the projector onto the zero-order manifold ^ 0 ) (13.83). 
The invariance equation (13.73) for the first-order correction = ^ 0 ) +^i 
takes the form: 

L*1 = - (l - Pf?) (Jd + Jh)*(0) (13.89) 

i = 0 

where L = (1 — — P$) is the symmetric operator. If the man- 

o 

ifold !P(o) is parameterized by the functionals Mo = f g o^(o) dQ and M = 

o o 

f m i QQ P( 0 ) dQ, where ^ eq mo and P eq QQ mi are lowest eigenvectors of 
Jd, then the general form of the solution is given by: 

'h = 'Z'eq ^ZoMoi'j : QQ) + Zi(M:QQ )(7 : QQ) 

+ 2 : 2 ( 7 - M + M - 7 } : QQ + 2:37 : M +I 7 : Qq| . (13.90) 

The terms zq through z% are the functions of Q 2 found as the solutions to 
some linear differential equations. 

We observe two features of the new manifold: 

o 

- first, it remains linear in variables Mo and M; 

second, it contains the dependence on the rate of strain tensor 7 . 

As the consequence, the transition to variables r is given by the linear rela¬ 
tions: 


o 

T P 

nfcgT 
trr p 
nksT 


O 

O OOO 

= r 0 M +riMo 7 + r 2 { 7 - M + M - 7 } + r 3 7 • 7 , 


o 

= PqMq +P 17 :M , 


(13.91) 
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where r* and Pi are some constants. Finally, the equations in terms of r should 
be also linear. It can be shown that the first-order correction to the modified 
Oldroyd 8 constants model (13.87) will be transformed into the equations of 
the following general structure: 

T + CiT[i] + |-^1 •T-/ 1 2+F , 2 

+r 3 (trr) + r 4 (r 5 : r) = -z/ 0 r 6 , (13.92) 


where r i through r q are tensors dependent on the rate-of-strain tensor 7 
and its first convective derivative 7 ^], constant c\ is the same as in (13.88) 
and uq is a positive constant. 

Because the explicit form of the tensors is quite extensive we do not 
present them here. Instead we offer several general remarks about the struc¬ 
ture of the first- and higher-order corrections: 

1 . Since the manifold (13.90) does not depend on the vorticity tensor uj = k — 
k\ the latter enters the equations (13.92) only via convective derivatives 
of r and 7 . This is sufficient to acquire the frame indifference, since all 
the tensorial quantities in dynamic equations are indifferent in any time 
dependent reference frame [361]. 

2. When k = 0, the first order equations (13.92) as well as equations for any 
order reduce to linear relaxation dynamics of slow modes: 


Dr Ai 

~Dt + X 


T = 0 


Dtl'T 

Dt 


. A 0 + 

+ — trr = 
A r 


0 , 


which is obviously concordant with the dissipativity and the slowness re¬ 
quirements. 

3. In all higher-order corrections one will be always left with linear manifolds 

o 

if the projector associated with functionals Mq\&] and M [\P] is used in 
every step. It follows that the resulting constitutive equations will always 
take a linear form (13.92), where all tensors ri depend on higher order 
convective derivatives of 7 (the highest possible order is limited by the 
order of the correction). Similarly to the first and zero orders the frame 
indifference is guaranteed if the manifold does not depend on the vorticity 
tensor unless the latter is incorporated in any frame invariant time deriv¬ 
atives. It is reasonable to eliminate the dependence on vorticity (if any) 
at the stage of constructing the solution to iteration equations (13.73). 

4. When the force F is linear, F = Q, we are led to Oldroyd-B model ((13.87) 
with Ci = 0 for i m 3,..., 8 ). This follows from the fact that the spectrum 
of the corresponding operator J d is more degenerated, in particular Ao = 
Ai = 1 and the corresponding lowest eigenvectors correspond to the simple 
dyad \l/ eq QQ. 
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13.5.7 Tests on the FENE Dumbbell Model 


In this section we specify the choice of the force law as the FENE spring 
(13.35), and present results of test calculations for the revised Oldroyd 8 
constants (13.85) equations on the examples of two simple viscometric flows. 
We introduce the extensibility parameter of FENE dumbbell model 6: 

b= = i3 • (i3 - 93) 


It was estimated [151] that b is proportional to the length of polymeric mole¬ 
cule and has a meaningful variation interval 50-1000. The limit b —» oo 
corresponds to the Hookean case and therefore to the Oldroyd-B constitutive 
equation. 

In our test calculations we compare our results with the Brownian dy¬ 
namic (BD) simulation data made on FENE dumbbell equations [363], and 
also with one popular approximation to the FENE model known as FENE-P 
(FENE-Peterelin) model [151,364,365]. The latter is obtained by selfconsis- 
tent approximation to the FENE force: 


F = 


1 

Hop 


Q 


(13.94) 


This force law, like the Hookean case, allows the exact moment closure leading 
to nonlinear constitutive equations [151,365]. Specifically, we use the modified 
variant of the FENE-P model, which matches the dynamics of the original 
FENE near equilibrium better than the classical variant. This is achieved by 
a slight modification of Kramers definition of the stress tensor: 


t p = nk B T( 1 - Ob) 1 - ( FQ) . (13.95) 

The case 0 = 0 gives the classical definition of FENE-P, while a more thor¬ 
ough estimation [354,365] is 6 = (6(6 + 2)) _1 . 


Constants 


The specific feature of the FENE model is that the length of dumbbells Q can 
vary only in a bounded domain of R 3 , namely inside a sphere S& = {Q 2 < 6}. 
The sphere Sb defines the domain of integration for averages (•) e = f Sb & e q • 

dQ, where the equilibrium distribution reads E eq = c -1 (l — Q 2 /6) 6 ^ 2 , c = 

Is b (1-Q7+ 2 d Q. 

In order to find constants for the zero-order model (13.85) we do the fol¬ 
lowing: First, we analytically compute the lowest eigenfunctions of operator 


Jd'- gi(Q 2 ) QQ and go{Q 2 ) without hydrodynamic interaction (n = 0). The 
functions go and gi were computed by a procedure presented in Subsect. 
“Auxiliary formulas, 1” with the help of the Maple V.S [366]. Second, we 
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calculate the perturbations terms ho,i by formulas (13.68) introducing the 
account of hydrodynamic interaction. Table 13.1 presents the constants Ao,i, 
a^, bi (13.79) (13.86) of the zero-order model (13.85) without hydrodynamic 
interaction (k = 0) for several values of extensibility parameter b. The rel¬ 
ative error <5 q,i (see Subsect. “Auxiliary formulas, 1 ”) of approximation for 
these calculations did not exceed the value 0.02. Table 13.2 shows the lin¬ 
ear correction terms for constants from Table 13.1 which take into account 
the hydrodynamic interaction: Aq ?1 = Ao,i(l + k(5 Ao,i)), = a$( 1 + K(Sai)), 
bf = bi( 1 + tv(Sbi)). The latter are calculated by substituting the perturbed 
functions mo,i = #o,i + into (13.79) and (13.86), and expanding them 
up to first-order in k. One can observe, since k > 0, the effect of hydrody¬ 
namic interaction results in the reduction of the relaxation times. 

Table 13.1. Values of constants to the revised Oldroyd 8 constants model computed 
on the base of the FENE dumbbells model 


b 

Ao 

Ai 

bo 

bi 

b 2 

ao 

20 

1.498 

1.329 -0.0742 

0.221 

1.019 

0.927 

50 

1.198 

1.135 -0.0326 

0.279 

1.024 

0.982 

100 

1.099 

1.068 -0.0179 

0.303 

1.015 

0.990 

200 

1.050 

1.035 0.000053 

0.328 

1.0097 

1.014 

oo 

1 

1 

0 

1/3 

1 

1 


Table 13.2. Corrections due to hydrodynamic interaction to the constants of the 
revised Oldroyd 8 constants model based on FENE force 


b 

<5A 0 

6Xi 

5 bo 

5b i 

Sb 2 

5ao 

20 

-0.076 

-0.101 

0.257 

-0.080 

-0.0487 

-0.0664 

50 

-0.0618 

-0.109 

-0.365 

0.0885 

-0.0205 

-0.0691 

100 

-0.0574 

-0.111 

-1.020 

0.109 

-0.020 

-0.0603 


Dynamic Problems 


The rest of this section concerns the computations for two particular flows. 
The shear flow is defined by 


k{t) = 7 (t) 


0 

0 

0 


1 

0 

0 


0 

0 

0 


(13.96) 


where y(t) is the shear rate, and the elongation flow corresponds to the choice: 
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k(t) = e(t) 


1 

0 

0 


0 0 

- 1/2 0 

0 - 1/2 


(13.97) 


where i(t) is the elongation rate. 

In test computations we look at viscometric material functions defined 
through the components of the polymeric part of the stress tensor r p . Namely, 
for shear flow they are the shear viscosity z/, the first and the second normal 
stress coefficients Vd, Vd, and for the elongation flow the only function is the 
elongation viscosity v. In dimensionless form they are written as: 


__ v - Z4 _ r P; 12 

nk^T\ v yn&BT’ 

2 = Vh = T P,22 ~ T p> n 

1 nk^TX^ rfrik^T 

'T _ Vd _ T33 ~ T p ,22 

2 7 2 uA:bT 

^ ^ 3z/ s _ ^"p,22 

n/cBTA r 5 tz/cbT 


(13.98) 

(13.99) 

(13.100) 

(13.101) 


where 7 = qA r and e = cA r are dimensionless shear and elongation rates. 
Characteristic values of the latter parameters 7 and e allow to estimate the 
parameter s\ (13.43). For all flows considered below the second flow parame¬ 
ter (Deborah number) £2 is equal to zero. 

Let us consider the steady state values of viscometric functions in steady 
shear and elongation flows: 7 = const, e = const. For the shear flow the 
steady values of these functions are found from (13.85) as follows: 


v = 62/(Ai - C7 2 ) , $1 = 2 n/Ai , ' 0 2 = 26 0 n/Ai , 

where c = 2/3(26§ + 25 0 — 1)/Ai + 26iao/Ao- Estimations for the constants 
(see Table I) show that c < 0 for all values of b (case c = 0 corresponds to b = 
00), thus all three functions are monotonically decreasing in absolute value 
with the increase of 7, besides the case b = 00. Although they qualitatively 
correctly predict the shear thinning for large shear rates due to a power 
law, but the exponent —2 in the limit of large 7 deviations from the values 
—0.66 for v and —1.33 for 7/1 observed in Brownian dynamic simulations 
[363]. It is explained by the fact that slopes of shear thining lie out of the 
applicability domain of our model. A comparison with BD simulations and 
modified FENE-P model is shown in Fig. 13.1. 

The predictions for the second normal stress coefficient indicate one more 
difference between the revised Oldroyd 8 constant equation and FENE-P 
model. FENE-P model shows zero values for 7/2 in any shear flow, either 
steady or time dependent, while the model (13.85), as well as BD simulations 
(see Fig. 9 in [363]) predict small, but nonvanishing values for this quantity. 
Namely, due to the model (13.85) in shear flows the following relation 7/2 = 
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b=50 



10 ° 10 2 

7 


Fig. 13.1. Dimensionless shear viscosity V and first normal stress coefficient vs. 

shear rate: (-) revised Oldroyd 8 constant model; (.) FENE-P model; 

(o o o) BD simulations on the FENE model; (—• — •—) Hookean dumbbell model 


bo'ipi is always valid, with proportionality coefficient bo small and mostly 
negative, which leads to small and mostly negative values of 7/2 • 

In the elongation flow the steady state value to # is found as: 


# = 


Ai 


_ 3^2 _ 

§(2&o + 1)^ — 7biao£ 2 /\o 


The denominator has one root on positive semi-axis 


( 9 \ 1/2 

/ 5A 0 (2&o + l) y AiAp \ 

\ 846iao / 7b\do J 


(13.102) 


(13.103) 


which defines a singularity point for the dependence $(£). The BD simula¬ 
tions [363] on the FENE dumbbell models shows that there is no divergence 
of elongation viscosity for all values of elongation rate (see Fig. 13.2). For 
the Hookean spring, £* = 1/2 while in our model (13.85) the singularity 
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Table 13.3. Singular values of elongation rate 


b 20 

50 

100 

120 

200 cx) 

£* 0.864 

0.632 

0.566 

0.555 

0.520 0.5 


b=50 



Fig. 13.2. Dimensionless elongation viscosity vs. elongation rate: (-) revised 

Oldroyd 8 constant model, (.) FENE-P model, (o o o) BD simulations on the 

FENE model; (—• — •—) Hookean dumbbell model 


point shifts to higher values with respect to decreasing values of b as it is 
demonstrated in Table 13.3. 

The Fig. 13.3 gives an example of dynamic behavior for elongation vis¬ 
cosity in the instant start-up of the elongational flow. Namely, it shows the 
evolution of initially vanishing polymeric stresses after instant jump of elon¬ 
gation rate at the time moment t — 0 from the value e = 0 to the value 
e = 0.3. 

It is possible to conclude that the revised Oldroyd 8 constants model 
(13.85) with estimations given by (13.86) for small and moderate rates of 
strain up to s\ = A r |^y|/(2Ai) ^ 0.5 yields a good approximation to the 
original FENE dynamics. The quality of the approximation in this interval 
is the same or better than the one of the nonlinear FENE-P model. 


13.5.8 The Main Results of this Example are as Follows: 

(i) We have developed a systematic method of constructing constitutive 
equations from the kinetic models of polymeric solutions. The method 
is free from a’priori assumptions about the form of the spring force and 
is consistent with the basic physical requirements: frame invariance and 
dissipativity of the internal motions of the fluid. The method extends 
the method of invariant manifold onto equations coupled with external 
fields. Two characteristic parameters of fluid flows were distinguished 
in order to account for the effect of the presence of external fields. The 
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Fig. 13.3. Time evolution of elongation viscosity after inception of the elongation 

flow with elongation rate e m 0.3: (-) revised Oldroyd 8 constant model, 

(.) FENE-P model, (— — —) BD simulations on FENE model; (—• — •—) 

Hookean dumbbell model 


iterative Newton scheme for obtaining a slow invariant manifold of the 
system driven by the flow with relatively low values of both characteristic 
parameters was developed. 

(ii) We demonstrated that the revised phenomenological Oldroyd 8 con¬ 
stants constitutive equations represent the slow dynamics of microscopic 
elastic models with any nonlinear spring force in the limit when the rate 
of strain and frequency of time variation of the flow are sufficiently small 
and microscopic states are taken not far from the equilibrium. 

(iii) The corrections to the zero-order manifold lead generally to linear in 
stresses equations but with highly nonlinear dependence on the rate of 
strain tensor and its convective derivatives. 

(iv) The zero-order constitutive equation is compared to the direct Brown¬ 
ian dynamics simulation for FENE dumbbell model as well as to pre¬ 
dictions of FENE-P model. This comparison shows that the zero-order 
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constitutive equation gives the correct predictions in the domain of its 
validity, but does not exclude qualitative discrepancy occurring out of 
this domain, particularly in elongation flows. 

This discrepancy calls for a further development, in particular, the use of 
nonlinear manifolds for derivation of zero-order model. The reason is in the 
necessity to provide concordance with the requirement of the positivity of 
distribution function. It may lead to nonlinear constitutive equation on any 
order of correction. 


13.6 Example: Explosion of Invariant Manifold, 

Limits of Macroscopic Description 

for Polymer Molecules, Molecular Individualism, 

and Multimodal Distributions 

Derivation of macroscopic equations from the simplest dumbbell models is re¬ 
visited [109]. It is demonstrated that the onset of the macroscopic description 
is sensitive to the flows. For the FENE-P model, small deviations from the 
Gaussian solution undergo a slow relaxation before the macroscopic descrip¬ 
tion sets on. Some consequences of these observations are discussed. A new 
class of closures is discussed, the kinetic multipeak polyhedra. Distributions of 
this type are expected in kinetic models with a multidimensional instability 
as universally, as the Gaussian distribution appears for stable systems. The 
number of possible relatively stable states of a nonequilibrium system grows 
as 2 m , and the number of macroscopic parameters is in order mn, where n 
is the dimension of configuration space, and m is the number of indepen¬ 
dent unstable directions in this space. The elaborated class of closures and 
equations describes effects of “molecular individualism”. 

13.6.1 Dumbbell Models and the Problem 
of the Classical Gaussian Solution Stability 

We shall again consider the simplest case of dilute polymer solutions repre¬ 
sented by dumbbell models. The dumbbell model reflects the two features 
of real-world macromolecules to be orientable and stretchable by a flowing 
solvent [151]. 

Let us consider the simplest one-dimensional kinetic equation for the con¬ 
figuration distribution function ^(g, £), where q is the reduced vector connect¬ 
ing the beads of the dumbbell. This equation is slightly different from the 
usual Fokker-Planck equation. It is nonlinear, because of the dependence of 
potential energy U on the moment 71^2^] = f q 2 lP(q)dq. This dependence 
allows us to get the exact quasiequilibrium equations on M 2 , but these equa¬ 
tions are not always solving the problem: this quasiequilibrium manifold may 
become unstable when the flow is present [109]. Here is this model: 
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dt* = ~d q {a(t)qV} + 1<%. (13.104) 

Here 

a(t) = K(t) - l/(M 2 (t)) , (13.105) 

K,(t) is the given time-dependent velocity gradient, t is the reduced time, 
and the function —fq is the reduced spring force. Function / may depend 
on the second moment of the distribution function M 2 = f q 2 &(q, t)dq. In 
particular, the case / = 1 corresponds to the linear Hookean spring, while / = 
[1 — M 2 (£)/ 6] _1 corresponds to the self-consistent finite extension nonlinear 
elastic spring (the FENE-P model [365]). The second moment M 2 occurs in 
the FENE-P force / as the result of the pre-averaging approximation to the 
original FENE model (with nonlinear spring force / = [1 — g 2 /5] -1 ). The 
parameter b changes the characteristics of the force law from Hookean at 
small extensions to a confining force for q 2 —> b. Parameter b is roughly equal 
to the number of monomer units represented by the dumbell and should 
therefore be a large number. In the limit b —» oc, the Hookean spring is 
recovered. Recently, it has been demonstrated that FENE-P model appears as 
first approximation within a systematic self-confident expansion of nonlinear 
forces [29]. 

Equation (13.104) describes an ensemble of non-interacting dumbells sub¬ 
ject to a pseudo-elongational flow with fixed kinematics. As is well known, 
the Gaussian distribution function, 


^ g (M 2 ) 


yor xp 



(13.106) 


solves equation (13.104) provided the second moment M 2 satisfies 


llVlo 

—j^— = 1 + 2a'(t)M 2 . 


(13.107) 


Solution (13.106) and (13.107) is the valid macroscopic description if all 
other solutions of the equation (13.104) are rapidly attracted to the family 
of Gaussian distributions (13.106). In other words [11], the special solution 

(13.106) and (13.107) is the macroscopic description if equation (13.106) is 
the stable invariant manifold of the kinetic equation (13.104). If not, then the 
Gaussian solution is just a member of the family of solutions, and equation 

(13.107) has no meaning of the macroscopic equation. Thus, the complete an¬ 
swer to the question of validity of the equation (13.107) as the macroscopic 
equation requires a study of dynamics in the neighborhood of the manifold 
(13.106). Because of the simplicity of the model (13.104), this is possible to 
a satisfactory level even for M 2 -dependent spring forces. 
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13.6.2 Dynamics of the Moments 
and Explosion of the Gaussian Manifold 


In [109] it was shown, that there is a possibility of “explosion” of the Gaussian 
manifold: with the small initial deviation from it, the solutions of the equa¬ 
tion (13.104) are fast going far from the manifold, and then slowly come 
back to the stationary point which is located on the Gaussian manifold. The 
distribution function ^ is stretched fast, but looses the Gaussian form, and 
after that the Gaussian form recovers slowly with the new value of M 2 . Let 
us describe briefly the results of [109]. 

Let M^n — f q 2ri} & dq denote the even moments (odd moments vanish 
by symmetry). We consider deviations i±2n — M 2 n ~ M^, where M G n 
f q 2ri] P G dq are moments of the Gaussian distribution function (13.106). Let 
^(g, £ 0 ) be the initial condition to (13.104) at time t = to- Introducing func¬ 
tions, 


P2n(Mo) = exp 



(13.108) 


where t > to, and 2 n > 4, the exact time evolution of the deviations P 2 n for 
2n > 4 reads 


= P4(t,t 0 )jLi4(to) t (13.109) 


and 


P2n(t) 


JU 2 n(to) + 2n(4n - 1) 



^2n-2{t , )p2n{t ', t 0 ) dt' 


P2n (tf ^ 0 ) 5 


(13.110) 

for 2 n > 6. Equations (13.108), (13.109) and (13.110) describe evolution 
near the Gaussian solution for arbitrary initial condition ^(g, to). Notice that 
explicit evaluation of the integral in (13.108) requires solution to the moment 
equation (13.107) which is not available in the analytical form for the FENE- 
P model. 

It is straightforward to conclude that any solution with a non-Gaussian 
initial condition converges to the Gaussian solution asymptotically as t —> 00 
if 


lim 

t —^00 



dt' < 0 . 


(13.111) 


However, even if this asymptotic condition is met, deviations from the 
Gaussian solution may survive for considerable finite times. For example, if 
for some finite time T, the integral in (13.108) is estimated as f a(t') dt' > 
a(t — to), a > 0, t < T, then the Gaussian solution becomes exponentially 
unstable during this time interval. If this is the case, the moment equation 
(13.107) cannot be regarded as the macroscopic equation. Let us consider 
specific examples. 

For the Hookean spring (/ = 1) under constant elongation (/c = const), 
the Gaussian solution is exponentially stable for k < 0.5, and it becomes 
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t 


Fig. 13.4. Deviations of reduced moments from the Gaussian solution as a function 
of reduced time t in pseudo-elongation flow for the FENE-P model. Upper part: 
Reduced second moment X — M^lb. Lower part: Reduced deviation of fourth 
moment from Gaussian solution Y = Solid : ft = 2, dash-dot : ft m 1, dash : 

ft — 0.75, long dash : ft — 0.5. (The figure from the paper [109], computed by P. Ilg.) 


exponentially unstable for ft > 0.5. The exponential instability in this case is 
accompanied by the well known breakdown of the solution to (13.107) due to 
the infinite stretching of the dumbbell. The situation is much more interesting 
for the FENE-P model because this nonlinear spring force does not allow the 
infinite stretching of the dumbbell [412,413]. 

Euations (13.107) and (13.109) were integrated by the 5-th order Runge- 
Kutta method with adaptive time step. The FENE-P parameter b was set 
equal to 50. The initial condition was *F(g,0) = C(1 — q 2 /b ) b / 2 , where C 
is the normalization (the equilibrium of the FENE model, notoriously close 
to the FENE-P equilibrium [363]). For this initial condition, in particular, 
/i 4 (0) = — 6b 2 /[(b + 3) 2 (6 + 5)] which is about 4% off the value of M 4 in the 
Gaussian equilibrium for b = 50. In Fig. 13.4 we demonstrate deviation /i 4 (t) 
as a function of time for several values of the flow. Function M 2 (t) is also 
given for comparison. For small enough ft we find an adiabatic regime, that 
is /i 4 relaxes exponentially to zero. For stronger flows, we observe an initial 
fast runaway from the invariant manifold with |/i 4 | growing over three orders 
of magnitude as compared to its initial value. After the maximum deviation 
is reached, /i 4 relaxes to zero. This relaxation is exponential as soon as the 
solution to (13.107) approaches the steady state. However, the time constant 
of this exponential relaxation |c^oo | is very small. Specifically, for large ft, 

ccoo = lim a(t) = —L + 0 (k -1 ) . 

t—>oo zb 


(13.112) 
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Thus, the steady state solution is unique and Gaussian but the stronger 
is the flow, the larger is the initial runaway from the Gaussian solution, 
while the return to it thereafter becomes flow-independent. Our observation 
demonstrates that, though the stability condition (13.111) is met, significant 
deviations from the Gaussian solution persist over the times when the solution 
of (13.107) is already reasonably close to the stationary state. If we accept 
the usually quoted physically reasonable minimal value of parameter b of the 
order 20 then the minimal relaxation time is of order 40 in the reduced time 
units of Fig. 13.4. We should also stress that the two limits, n —> oc and 
b —> oo, are not commutative, thus it is not surprising that the estimation 
(13.112) does not reduce to the above mentioned Hookean result as b —> 
oo. Finally, peculiarities of convergence to the Gaussian solution are even 
furthered if we consider more complicated (in particular, oscillating) flows 
n(t). Further numerical experiments are presented in [110]. The statistics of 
FENE-P solutions with random strains was studied recently [368] 


13.6.3 Two-Peak Approximation for Polymer Stretching 
in Flow and Explosion of the Gaussian Manifold 

In accordance with [369], the ansatz for & can be suggested in the following 
form: 


* An (W ,?},<?) = 




(g+o 


+ e 


(g-o 


(13.113) 


Natural inner coordinates on this manifold are a and q. Note, that now a 2 
M 2 . The value a 2 is a dispersion of one of the Gaussian summands in (13.113), 


M 2 (V An ({a,q},q)) = a 2 +q 2 


To build the thermodynamic projector on the manifold (13.113), the thermo¬ 
dynamic Lyapunov function is necessary. It is necessary to emphasize that 
equations (13.104) are nonlinear. For such equations, the arbitrarity in the 
choice of the thermodynamic Lyapunov function is much smaller than for 
the linear Fokker-Planck equation. Nevertheless, such a thermodynamic Lya¬ 
punov function exists. It is the free energy 


F = U{M 2 [&}) - TS[&] , (13.114) 


where 


sm = -f 


- l)d q , 


U(M 2 [\P]) is the potential energy in the mean field approximation, T is the 
temperature (below we assume T = 1). 
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Note that the Kullback-form entropy [156] Sk = — /#Tn (JL) d q also 
has the form Sk = — F/T : 

F* = exp (-U) , 

Sk[&] = ~{U) — J <Fln<Fd q. 

If I/(M 2 [^]) in the mean field approximation is the convex function of M 2 , 
then the free energy (13.114) is the convex functional too. 

For the FENE-P model U = — ln[l — M 2 / 6 ]. 

In accordance with thermodynamics the vector I of the flow of F must 
be proportional to the gradient of the corresponding chemical potential fi\ 


fi = 


I = -B (!P)V,m , 
(13.1 

dU{M 2 ) 2 


where // = Z? > 0 . From (13.114) it follows that 


dM 2 

I = -B(&) 


q z + ln!F ; 

„ dU , ' 

2 5jS-« + a> ^ 


If we assume here B = then we get 


I = -D 


dU T 1 ' 

dMi 94 >+ 2 V * S> 




(13.115) 


(13.116) 


(13.117) 


When D = 1 this equation coincides with (13.104) in the absence of the flow, 
and dF/dt < 0 due to (13.117). 

Let us construct the thermodynamic projector with the help of the ther¬ 
modynamic Lyapunov function F (13.114). Corresponding entropic scalar 
product at the point F has the form 


iflah 


d 2 U 
dM .I 


M 2 =M 2 [&] 


J q 2 f(q)dq ■ j q 2 g(q)dq + j &q . 


(13.118) 

When stuying the ansatz (13.113), the scalar product (13.118) constructed 
for the corresponding point of the Gaussian manifold with M 2 = a 2 will 
be used. This will allow us to investigate the neighborhood of the Gaussian 
manifold (and to get all the results analytically): 


(/Is) 


d 2 U 

dM$ 


M 2 =a 2 


• j q 2 f{q) dq- J q 2 g(q) dq 



f(q)g(q) dq. 


(13.119) 
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Also we need to know the functional DfF at the point of Gaussian manifold: 


(dU(M 2 ) 

DfFAf)= (^MT 




M 2 =<t 2 


2<t 2 


jjq 2 f(q)dq, (13. 


120 ) 


(subject to the condition f f(q ) dg = 0). The point 


dU (M 2 ) 


dM 2 


2<7 2 


corresponds to the equilibrium. 

The tangent space to the manifold (13.113) is spanned by the vectors 


QF An dF An 

fcr = W7 yr 5 A = 


A = 
A = 


1 


d(a 2 )’ “ a^ 2 ) ’ 

_(a±5)i (<? + ?) 2 - O’ 2 _(£z^(g-?) 2 -cr 2 

e 2 cr 2 --- 1 - e 2 o - 2 --- 


(13.121) 


4cr 3 \/27r |_ 

1 

4cr 2 ^V / 27r 


+ (q~s) 

—e 2 a 2 - e 2 cr 2 - 


The Gaussian entropy (free energy) production in the directions / a and f q 
(13.120) has a very simple form: 


DFM) = DF a ,{f a ) 


dU(M 2 ) 

dM 2 


M 2 =<t 2 


1 

2^2 ' 


(13.122) 


The linear subspace ker DF a 2 in lin{/ CT , /( } is spanned by the vector — f a . 

Let us consider the given vector field dF/dt = J{F) at the point F({a, <,}). 
We need to build the projection of J onto the tangent space T as at the point 
^({<J,c}): 

Pt h ,{J) = <PaU + Fife • (13-123) 

This equation means that the equations for u 2 and ? 2 will have the form 


d<r 2 
d t 


= Vv 


dA 

d t 


= (f, . 


(13.124) 


Projection (<^ CT , tp q ) can be found from the following two equations: 


<i Pa + ¥<; 


J q 2 J(F)(q)dq- 


(<Ar/< t + <P<;Mfa ~ A)<r 2 = (J(&)\fcr ~ fs ) a 2 , 


(13.125) 


where (f\g ) a 2 = {J{F)\f a — A) CT 2 , (13.118). First equation of (13.125) means, 
that the time derivative dil^/dt is the same for the initial and the re¬ 
duced equations. Due to the formula for the dissipation of the free energy 
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(13.120), this equality is equivalent to the persistence of the dissipation in 
the neighborhood of the Gaussian manifold. Indeed, in according to (13.120) 
dF/dt = A(a 2 ) f q 2 J(F)(q) dq = A(a 2 )dM 2 /dt , where A(a 2 ) does not de¬ 
pend of J. On the other hand, the time derivative of M 2 due to projected 
equation (13.124) is (p a + because M 2 = a 2 + q 2 . 

The second equation in (13.125) means, that J is projected orthogonally 
on ker DfS fj T as . Let us use the orthogonality with respect to the entropic 
scalar product (13.119). The solution of equations (13.125) has the form 

dP = {J\fa - + M 2 (J )((/,|/,) <t2 - (f a \fM 

d t (f a - f q \f a - f q )„2 

(13.126) 

dP = -PI/. ~ U)** + M 2 (J)((/ g |/ g ) g 2 - (U\fM 

d t ^ (/. ~ h\fa ~ A ).2 

where J = J{9), M 2 (J) = / q 2 J(^)dq. 

It is easy to check, that the formulas (13.126) are indeed defining the 
projector: if f a (or f q ) is substituted instead of the function J, then we get 
ifo- = 1, (£<; = 0 (or ip a- = 0, ip q = 1, respectively). Let us substitute the 
right part of the initial kinetic equations (13.104), calculated at the point 
&(q) = ^({< 7 , ^}, q) (see (13.113)) in (13.126) instead of J. We shall get the 
closed system of equations on cr 2 ,^ 2 in the neighborhood of the Gaussian 
manifold. 

This system describes the dynamics of the distribution function F. The 
distribution function is represented as the half-sum of two Gaussian distri¬ 
butions with the averages of distribution and mean-square deviations a. 
All integrals in the right-hand part of (13.126) are possible to calculate ana¬ 
lytically. 

The basis (/ a ,A) is convenient to use everywhere except for the points 
on the Gaussian manifold, q = 0, because if ^ —> 0, then 


Let us analyze the stability of the Gaussian manifold with respect to the 
“dissociation” of the Gaussian peak in two peaks (13.113). In order to do 
this, it is necessary to find the first nonvanishing term in the Taylor series 
expansion in q 2 of the right-hand side of the second equation in the system 
(13.126). The denominator has the order of the numerator has, as it is 
easy to see, the order not less, than q 6 (because the Gaussian manifold is 
invariant with respect to the initial system). 

With the accuracy up to q 4 : 


1 cfc 2 <r 
CT 2 d t ~ 2 V 


(13.127) 
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Fig. 13.5. Phase trajectories for the two-peak approximation, FENE-P model. 
The vertical axis (5 = 0) corresponds to the Gaussian manifold. The triangle with 
a (M 2 ) > 0 is the domain of exponential instability 


where 


a = k — 


dU (M 2 ) 
dM 2 


M 2 =cj 2 


Thus, if a > 0, then q 2 grows exponentially (q ^ e at ) and the Gaussian 
manifold is unstable; if a < 0, then q 2 decreases exponentially and the 
Gaussian manifold is stable. 

Near the vertical axis dcr 2 /dt = 1 + 2 aa 2 . The form of the phase trajecto¬ 
ries is shown qualitative on Fig. 13.5. Note that this result completely agrees 
with equation (13.109). 2 

For the linear Fokker-Planck equation with a non-linear force law (for 
example, with the FENE force) the motion in the presence of the flow can 
be represented as the motion in the effective potential well U(q) = U(q) — 
\nq 2 . Different variants of the phase portrait for the FENE potential are 
present on Fig. 13.6. Instability and dissociation of the unimodal distribution 
functions (“peaks”) for the FPE is the general effect when the flow is present. 
The instability occurs when the matrix d 2 U/dqidqj starts to have negative 
eigenvalues (U is the effective potential energy, U(q) = U(q) — \ ■ i^i^qiqj)- 


13.6.4 Polymodal Polyhedron and Molecular Individualism 

What are the possible physical consequences of the instability of the Gaussian 
manifolds? The discovery of the molecular individualism for dilute polymers 

2 Pavel Gorban calculated the projector (13.126) analytically without Taylor ex¬ 
pansion and with the same, but exact result: d<^ 2 /dt — 2 a^ 2 , dcr 2 /dt = 1 + 2 acr 2 . 
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Fig. 13.6. Phase trajectories for the two-peak approximation, FENE model: (a) 
A stable equilibrium on the vertical axis, one stable peak; (b) A stable equilibrium 
with s > 0, stable two-peak configuration 


in the elongational flow [370] was the challenge to theory from the very 
beginning. “Our data should serve as a guide in developing improved mi¬ 
croscopic theories for polymer dynamics”... was the concluding sentence of 
the paper [370]. P.G. de Gennes invented the notion “molecular individu¬ 
alism” [371]. He stressed that in this case the usual averaging procedures 
are not applicable. At the highest strain rates distinct conformation shapes 
with different dynamics were observed [370]. Further works for the shear 
flow demonstrated not only shape differences, but large temporal fluctua¬ 
tions [372]. 

Equation for the molecules in a flow are known. These are the Fokker- 
Planck equations with external force. The theory of the molecular individu¬ 
alism is hidden inside these equations. Following the logic of model reduction 
we should solve two problems: to construct the slow manifold, and to project 
the equation on this manifold. The second problem is solved: the thermody¬ 
namic projector is necessary for this projection. 

How to solve the first problem? We can find a hint in previous subsec¬ 
tions. The Gaussian distributions form the invariant manifold for the FENE-P 
model of polymer dynamics, but this manifold can become unstable in the 
presence of a flow. We propose to model this instability as dissociation of the 
Gaussian peak into two peaks. This dissociation describes appearance of an 
unstable direction in the configuration space. 

In the one-dimensional FENE-P model of the preceding section the poly¬ 
mer molecule is represented by one coordinate: the stretching of the molecule 
(the connector vector between the beads). There is a simple mean field gen¬ 
eralized models for multidimensional configuration spaces of molecules. In 
these models, dynamics of distribution functions is described by the Fokker- 
Planck equation in a quadratic potential well. The matrix of coefficients of 
this quadratic potential depends on the matrix of the second order moments 
of the distribution function. The Gaussian distributions form the invariant 
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manifold for these models, and the first dissociation of the Gaussian peak 
after the emergence of the unstable direction in the configuration space has 
the same nature and the same description, as for the one-dimensional models 
of molecules considered below. 

At a higher strain, new unstable directions can appear, and corresponding 
dissociations of Gaussian peaks form a cascade of dissociation. For m unsta¬ 
ble directions we get the Gaussian parallelepiped: The distribution function 
is represented as a sum of 2 m Gaussian peaks located in the vertices of par¬ 
allelepiped: 


*(«) = 


i 

2 m (27r) n / 2 \J det £ 


x ^2 ex p 

£i=± 1, () 



(13.128) 



where n is the dimension of the configurational space, 2 q is the vector of the 
ith edge of the parallelepiped, £ is the one-peak covariance matrix (in this 
model, £ is the same for all peaks). The macroscopic variables for this model 
are: 

1. The covariance matrix £ for a peak; 

2. The set of vectors q (or the parallelepiped edges). 

The stationary polymodal distribution for the Fokker-Planck equation 
corresponds to the persistence of several local minima of the function U(q). 
The multidimensional case is different from one-dimensional because it has 
the huge amount of possible configurations. An attempt to describe this pic¬ 
ture quantitative meet the following obstacle: we do not know the details 
of the potential [7, on the other hand, the effect of molecular individual¬ 
ism [370-372] seems to be universal in its essence, that is, independent of 
details of interactions. 

We should find a mechanism that is as general, as the effect. The simplest 
dumbbell model which we have discussed in the previous subsection does not 
explain the effect, but it gives us a hint: the flow can violate the stability of 
unimodal distributions. If we assume that the whole picture is hidden inside a 
multidimensional Fokker-Planck equation for a large molecule in a flow, then 
we can use this hint in such a way: when the flow strain grows, there appears a 
sequence of bifurcations, and for each of them a new unstable direction arises. 
For the qualitative description of such a picture we can apply a language of 
normal forms [373], subject to a certain modification. 

The bifurcation in dimension one with appearance of two point of minima 
from one point has the simplest polynomial representation: U(q, a) = q 4 + 
aq 2 . If a > 0, then this potential has one minimum, if a < 0, then there 
are two points of minima. The normal form of degenerated singularity is 
U(q) = q 4 . Such polynomial forms as q 4 + aq 2 are very simple, but they have 
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inconvenient asymptotic at q —> oo. For our goals it is more appropriate to 
use logarithms of convex combinations of Gaussian distributions instead of 
polynomials. It is the same class of jets near the bifurcation, but with given 
quadratic asymptotic q —■> oo. If one needs another class of asymptotic, it 
is possible just to change the choice of the basic peak. All normal forms of 
the critical form of functions, and families of versal deformations are well 
investigated and known [373]. 

Let us represent the deformation of the probability distribution under 
the strain in multidimensional case as a cascade of peak dissociation. The 
number of peaks will duplicate on the each step. The possible cascade of peaks 
dissociation is presented qualitatively on Fig. 13.7. The important property 
of this qualitative picture is the linear complexity of dynamical description 
with exponential complexity of geometrical picture. Let m be the number of 
bifurcation steps in the cascade. Then 

- For description of parallelepiped it is sufficient to describe m edges; 

- There are 2 m_1 geometrically different conformations associated with 2 m 
vertex of parallelepiped (central symmetry halved this number). 



Fig. 13.7. Cartoon representing the steps of molecular individualism. Black dots 
are vertices of Gaussian parallelepiped. Zero, one, and four-dimensional polyhe¬ 
drons are drawn. Presented is also the three-dimensional polyhedron used to draw 
the four-dimensional object. Each new dimension of the polyhedron adds as soon 
as the corresponding bifurcation occurs. Quasi-stable polymeric conformations are 
associated with each vertex. First bifurcation pertinent to the instability of a dumb¬ 
bell model in elongational flow is described in the text 
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Another important property is the threshold nature of each dissociation: It 
appears in points of stability loss for new directions, in these points the 
dimension of unstable direction increases. 

Positions of peaks correspond to parallelepiped vertices. Different vertices 
in configuration space present different geometric forms. So, it seems plausi¬ 
ble 2, that observed different forms (“dumbbels”, “half-dumbbels”, “kinked”, 
“folded” and other, not classified forms) correspond to these vertices of par¬ 
allelepiped. Each vertex is a metastable state of a molecule and has its own 
basin of attraction. A molecule goes to the vertex which depends strongly on 
details of initial conditions. 

The simplest multidimensional dynamic model is the Fokker-Planck equa¬ 
tion with quadratic mean field potential. This is direct generalization of the 
FENE-P model: the quadratic potential U ( q ) depends on the tensor of second 
moments M 2 = {qiqf) (here the angle brackets denote the averaging). This 
dependence should provide the finite extensibility. This may be, for example, 
a simple matrix generalization of the FENE-P energy: 

U(q) = Y.Kijqtqj, K = K° + </>(M 2 /b), (U(q )) = tr(K M 2 /b) 
ij 

where b is a constant (the limit of extensibility), K° is a constant matrix, 
M 2 is the matrix of second moments, and 0 is a positive analytical monotone 
increasing function of one variable on the interval (0,1), (j)(x) —> 00 for x —> 1 
(for example, c/)(x) = — ln(l — x)/x, or </>(x) = (1 — x) _1 ). 

For quadratic multidimensional mean field models persists the qualitative 
picture of Fig. 13.5: there is non-stationary moleqular individualism for sta¬ 
tionary u molecular collectivism”. The stationary distribution is the Gaussian 
distribution, and on the way to this stationary point there exists an unstable 
region, where the distribution dissociates onto 2 m peaks (m is the number of 
unstable degrees of freedom). 

Dispersion of individual peak in unstable region increases too. This effect 
can deform the observed situation: If some of the peaks have significant inter¬ 
section, then these peaks join into new extended classes of observed molecules. 
The stochastic walk of molecules between connected peaks can be observed 
as “large non-periodical fluctuations”. This walk can be unexpected fast, be¬ 
cause it can be effectively a motion in a low-dimensional space , for example, 
in one-dimensional space (in a neighborhood of a part of one-dimensional 
skeleton of the polyhedron). 

3 We can not prove it now, and it is necessary to determine the status of proposed 
qualitative picture: it is much more general than a specific model, it is the mecha¬ 
nism which acts in a wide class of models. The cascade of instabilities can appear 
and, no doubt, it appears for the Fokker-Planck equation for a large molecule in 
a flow. But it is not proven yet that the effects observed in well-known experi¬ 
ments have exactly this mechanism. This proof requires quantitative verification 
of a specific model. And now we talk not about a proven, but about the plausible 
mechanism which typically appears for systems with instabilities. 
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We discussed the important example of ansatz: the multipeak models. 
Two examples of these type of models demonstrated high efficiency during 
decades: the Tamm-Mott-Smith bimodal ansatz for shock waves, and the the 
Langer-Bar-on-Miller [374-376] approximation for spinodal decomposition. 

The multimodal polyhedron appears every time as an appropriate approx¬ 
imation for distribution functions for systems with instabilities. We create 
such an approximation for the Fokker-Planck equation for polymer mole¬ 
cules in a flow. Distributions of this type are expected to appear in each 
kinetic model with multidimensional instability as universally, as Gaussian 
distribution appears for stable systems. This statement needs a clarification: 
everybody knows that the Gaussian distribution is stable with respect to 
convolutions, and the appearance of this distribution is supported by cen¬ 
tral limit theorem. Gaussian polyhedra form a stable class: convolution of 
two Gaussian polyhedra is a Gaussian polyhedron, convolution of a Gaussian 
polyhedron with a Gaussian distribution is a Gaussian polyhedron with the 
same number of vertices. On the other hand, a Gaussian distribution in a po¬ 
tential well appears as an exponent of a quadratic form which represents the 
simplest stable potential (a normal form of a nondegenerated critical point). 
Families of Gaussian parallelepipeds appear as versal deformations with given 
asymptotic for systems with cascade of simplest bifurcations. 

The usual point of view is: The shape of the polymers in a flow is either 
a coiled ball, or a stretched ellipsoid, and the Fokker-Planck equation de¬ 
scribes the stretching from the ball to the ellipsoid. It is not the whole truth, 
even for the FENE-P equation, as it was shown in [109,369]. The Fokker- 
Planck equation describes the shape of a probability cloud in the space of 
conformations. In the flow with increasing strain this shape changes from the 
ball to the ellipsoid, but, after some thresholds, this ellipsoid transforms into 
a multimodal distribution which can be modeled as the peak parallelepiped. 
The peaks describe the finite number of possible molecule conformations. The 
number of this distinct conformations grows for a parallelepiped as 2 m with 
the number m of independent unstable direction. Each vertex has its own 
basin of attraction. A molecule goes to the vertex which depends strongly on 
details of initial conditions. 

These models pretend to be the kinetic basis for the theory of molecular in¬ 
dividualism. The detailed computations will be presented in following works, 
but some of the qualitative features of the models are in agreement with 
some of qualitative features of the picture observed in experiment [370-372]: 
effect has the threshold character, different observed conformations depend 
significantly on the initial conformation and orientation. 

Some general questions remain open: 

Of course, appearance of 2 m peaks in the Gaussian parallelepiped is pos¬ 
sible, but some of these peaks can join in following dynamics, hence the 
first question is: what is the typical number of significantly different peaks 
for a m —dimensional instability? 
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- How can we decide what scenario is more realistic from the experimental 
point of view: the proposed universal kinetic mechanism, or the scenario 
with long living metastable states (for example, the relaxation of knoted 
molecules in the flow can give an other picture than the relaxation of 
unknoted molecules)? 

The analysis of random walk of molecules from peak to peak should be 
done, and results of this analysis should be compared with observed large 
fluctuations. 

The systematic discussion of the difference between the Gaussian elipsoid 
(and its generalizations) and the Gaussian multipeak polyhedron (and its 
generalizations) seems to be necessary. This polyhedron appears generically 
as the effective ansatz for kinetic systems with instabilities. 


14 Dimension of Attractors Estimation 


How can we prove that all the attractors of an infinite-dimensional system 
belong to a finite-dimensional manifold? How can we estimate the dimensions 
of attractor? There exist two methods to obtain such estimations. 

First, if we find that k-dimensional volumes are contracted due to dy¬ 
namics, then (after some additional technical steps) we can claim that the 
Hausdorff dimension of the maximal attractor is less than k. 

Second, if we find a representation of our system as a nonlinear ki¬ 
netic system with conservation of supports of distributions, then (again, af¬ 
ter some additional technical steps) we can state that the asymptotics is 
finite-dimensional. This conservation of support has a quasi-biological inter¬ 
pretation, inheritance (if a gene was not presented initially in an isolated 
population without mutations, then it cannot appear at later time). The 
finite-dimensional asymptotic demonstrates effects of “natural” selection. 

In this chapter we describe these approaches. 


14.1 Lyapunov Norms, Finite-Dimensional Asymptotics 
and Volume Contraction 

In a general case, it is impossible to prove the existence of a global Lyapunov 
function on the basis of local data. We can only verify or falsify the hypothesis 
about a given function, is it a global Lyapunov function, or is it not. On the 
other hand, there exists a more strict stability property which can be verified 
or falsified (in principle) with local data analysis. This is a Lyapunov norm 
existence. 

A norm || • || is the Lyapunov norm for the system (13.1), if for any two so¬ 
lutions x^\t), x^ 2 \t), t > 0, the function \\x^\t) — x{2) {t) II is non-increasing 
in time. 

A linear operator A is dissipative with respect to a norm || • ||, if exp (At) 
(t > 0) is a semigroup of contractions: ||exp(At)x|| < \\x\\ for any x and 
t > 0. A family of linear operators {A a } ae x is simultaneously dissipative , if 
all operators A a are dissipative with respect to some norm || • || (it should 
be stressed that in this definition one requires one norm for all A a , a G K). 
The mathematical theory of simultaneously dissipative operators for finite¬ 
dimensional spaces was developed in [299-303]. 
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Let the system (13.1) 

dx , \ , x 

= J\%) + Jex (*^ 5 1) 5 % U 

be defined in a convex set V C E, and A x be Jacobi operator at the point 
x: A x = D x ( J{x) + J ex {x)). This system has a Lyapunov norm, if the family 
of operators {A x } xe jj is simultaneously dissipative. If one can choose such 
e > 0 that for all A x , t > 0, any vector z, and this Lyapunov norm 

||exp(A x t) 2 r|| < exp(—ert)||^|| , 

then for any two solutions x^\t), x( 2 \t), t > 0 of equations (13.1) 

|| x^\t) — x^ 2 \t) || < exp(—5t)||x^^(0) — x( 2 )(0)|| . 

The existence of the Lyapunov norm is a very strong restriction on non¬ 
linear systems, and such systems are not widespread in applications. But if 
we go from the distance contraction to the contraction of the k -dimensional 
volumes (k = 2,3,...) [311], the situation changes dramatically. There exist 
many kinetic systems with a monotonous contraction of the k -dimensional 
volumes for sufficiently large k (see, for example, [173,317,318,334]). Let 
x(t), t > 0 be a solution of equation (13.1). Let us write the first approxima¬ 
tion equation for small variation of x(t): 

d Ax . . A „ x 

^ — A x (t)^x . (14.1) 

This is a linear system with coefficients dependent on t. Let us study how 
the system (14.1) changes the ^-dimensional volumes. For ^-dimensional par¬ 
allelepiped with the edges x^\x^ 2 \ ... x^ we can define an element of the 
kth exterior power, the oriented volume: 

z (1) A a; (2) A ... A x^ k) eBABA...AB = A k E , 

k 

(this is an antisymmetric tensor or /c-vector). A norm in the kth exterior 
power of the space E is a measure of the A;-dimensional volumes (one of the 
possible measures). Dynamics of volumes induced by the system (14.1) is 
given by equations 

^(Ar (1) A Ar (2) A ... A Ax (k) ) = (. A x(t) Ax «) A Ax (2) A ... A Ax W 

+Ax {1) A (A x{t) A X W) A ... A Ax {k) + ... 

+Ax^ A Ax A ... A (A x (t)Ax <*>) 

= (A k D A x(t) )(Ax w A Ax^ A ... A Ar (fe) ) . (14.2) 
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Here A k D A x ^ are operators of the induced differential action of A x ^ on 
the kth exterior power of E. Again, a decrease of \\Ax^ AAx^ A.. .A Ax^ || 
in time is equivalent to dissipativity of all the operators A^A^), t > 0 in the 
norm ||«||. Existence of such a norm for all A k D A x ^ (x G U) is equivalent to the 
contraction of the volumes of all parallelepipeds due to first approximation 
system (14.1) for any solution x(t) of equations (13.1). We shall call such a 
system the k-contraction. If one can choose such e > 0 that for all A x {pc £ £/), 
any vector zeEAEA...AE, and this norm, 

|| exp (A k D A x{t) t) z\\ < exp(—ei)||4 , 

then the volumes of the parallelepipeds contract exponentially as exp(— et). 

For such systems we can estimate the Hausdorff dimension of the attractor 
(under some additional technical conditions about solutions boundedness): it 
cannot exceed k. It is necessary to stress here that this estimation of the 
Hausdorff dimension does not solve the problem of construction of the in¬ 
variant manifold containing this attractor, and one needs special technique 
and additional restriction on the system in order to obtain this manifold 
(see [318,342,346,347]). 

Let us remind here the definition of the Hausdorff dimension of metric 
space (subset of a normed space, for example). Let X be a metric space, and 
d be a number. The d-dimensional Hausdorff measure of X, H d (X ), is the 
infimum of positive numbers y such that for every r > 0, X can be covered by 
a countable family of closed balls, each of diameter less than r, such that the 
sum of the dth powers of their diameters is less than y. Note that H d (X ) may 
be infinite, and d need not be an integer. The Hausdorff dimension Dh(X) 
of X is the infimum of such d > 0 that the H d (X) = 0: 

D h (X ) = inf{d > 0| H d {X) = 0} . 

The simplest way for construction of the slow invariant manifold becomes 
available for systems with a dominance of the linear part in higher dimensions. 
Let an infinite-dimensional system have a form: u + Au — R{u ), where the 
operator A is self-adjoint, and has discrete spectrum A^ (Ai < A 2 < ..., 
A i —> 00 ) with sufficiently big gaps between the eigenvalues A^, and R(u) is 
continuous. Let Ei be the eigenspace of A for the eigenvalue Aand all the Ei 
are finite-dimensional spaces. One can build the slow manifold as the graph 
over the space ®^j Ei for some k. Indeed, let the basis consists of eigenvectors 
of A. In this basis fq = —A*iq + Ri(u ), and it seems plausible that, for 
some k and sufficiently big i, the functions rq(t) exponentially fast tend to 
iq(iq(£),.. .Uk(t)), if Ri(u) are bounded and continuous in a suitable sense. 
Here ... u^) are some smooth functions that describe the manifold with 

internal coordinates rq,... Uk- 

Variants of rigorous theorems about systems with such a dominance of 
the linear part in higher dimensions may be found in literature (see, for ex¬ 
ample, the textbook [100]). Even if all the sufficient conditions hold, efficient 
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computation of these manifold remains the problem, and various strategies 
of calculations are proposed: from the Euler method for the manifold correc¬ 
tion [25] to various algorithms of discretization [13,105,343]. 

The simplest condition of simultaneous dissipativity for the family of op¬ 
erators {A x } can be obtained in a following way: let us take a norm || • ||. If all 
operators A x are dissipative with respect to this norm, then the family A x 
is (obviously) simultaneously dissipative in this norm. So, we can verify or 
falsify a hypothesis about the simultaneous dissipativity for a given norm. 
Simplest examples are provided by the quadratic and l 1 norms. 

For the quadratic norm associated with a scalar product (|) the dissipa¬ 
tivity of the operator A is equivalent to nonpositivity of the spectrum of the 
operator A + A + , where A + is the adjoint to A operator with respect to scalar 
product (|). 

For the l 1 norm with weights ||x|| = JT Wi\xi\,Wi > 0, the condition of the 
operator’s A dissipativity in this norm is the weighted diagonal dominance 
for columns of the matrix A = (a^*): 



3, 


For the exponential contraction, it is necessary and sufficient that some 
gap exists in the dissipativity inequalities: 

- For the quadratic norm, 


cr(A + A + ) < £ < 0 


where a (A + A + ) is the spectrum of A + A + ; 
For the l 1 norm with weights, 



Sufficient conditions of simultaneous dissipativity can have a different form 
(not only the form of dissipativity checking with respect to a given norm) 
[300-303], but the problem of necessary and sufficient conditions in a general 
case remains open. 

The dissipativity conditions for operators A k D A x of the differential induced 
action of A x on the fcth exterior power of E have a similar form. If we know the 
spectrum of A x +A+, then it is easy to find the spectrum of /\ k D A x + (/\ k D A x ) + . 
For example, for simple discrete spectrum each eigenvalue of this operator is 
a sum of fc distinct eigenvalues of A x + A +. 

A basis of the fcth exterior power of E can be constructed from the basis 
{ei} of E: it is 


^ ^*2 A ... A i\ < %2 < • • • < ik • 
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For the l 1 norm with weights in the kth exterior power of E the set of weights 
is > 0, i\ < i 2 < • • • < ik}- The norm of a vector 2 is 

Ill'll = w iii2-»ik\ z iii2---ik \ ■ 

ii<i2<---<ik 


The dissipativity conditions for operators Aj^A x ^ of the induced differential 
action of A in the l 1 norm with weights have the form: 

^i\i\ T CLi 2 i 2 T • • • T CLi k i k 0 , 

k 

w hi2---ik \ a iiii + a i2i2 + • • • T CLi k i k \ > W iii 2 ---ik I a 3H I 

1 =1 j, j&i,i2,—ik 

for any ii < £2 < • • • < ik ? (14.3) 

where ik = re/, the multiindex / consists of indexes (p/ /), and j. 

For infinite-dimensional systems the problem of volume contraction and 
Lyapunov norms for exterior powers of E consists of three parts: the geo¬ 
metrical part that concerns the choice of norm for simultaneous dissipativity 
of operator families, the topological part that concerns the topological non¬ 
equivalence of the constructed norms, and estimation of the bounded set 
(the so-called absorbing set ) containing a compact attractor. This appropri¬ 
ate apriori estimations of the bounded convex positively invariant set V C U 
where the compact attractor is situated may become a difficult problem. 

The estimation of the attractor dimension based on Lyapunov norms in 
the exterior powers is rather rough. This is a local estimation. Refined es¬ 
timations are based on global Lyapunov exponents (Lyapunov or Kaplan- 
Yorke dimension [308,309]). There are many different measures of the di¬ 
mension [307,310], and much effort is invested towards better estimates of 
various dimensions [345]. 

Estimations of the dimension of attractors was given for various systems: 
from the Navier-Stokes hydrodynamics [316] to the climate dynamics [312]. 
An introduction and a review of many results is presented in the book [318]. 
The local estimations remain the main tool for the estimation of the attrac¬ 
tors dimension, because global estimations for complex systems are much 
more complicated and often just unattainable because of the computational 
complexity. 


14.2 Examples: Lyapunov Norms for Reaction Kinetics 

In this section we consider the reaction kinetics systems which obey the 
mass action law. The direct and reverse reactions will be represented in the 
stoichiometric equations separately, and the reaction mechanisms under con¬ 
sideration can include an elementary reaction without its reverse reaction. 
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Neither detailed balance, nor other dissipation requirements are presumed. 
Such schemes appear, for example, in modeling of catalytic reactions, where 
only part of the components are included into equations, and concentrations 
of other components are used as parameters [81]. 

The simplest class of nonlinear kinetic (open) systems with Lyapunov 
norms was described in the paper [304]. These are reaction systems with¬ 
out interactions of various substances. The stoichiometric equation of each 
elementary reaction has a form 

c^rA-ir > 'y ^ (3 r j Aj , (14.4) 

3 

where r enumerates reactions, i r is defined for each reaction a r , (3 r j are non¬ 
negative stoichiometric coefficients (usually they are integer), Ai are symbols 
of substances. 

In the left hand part of equation (14.4) there is one initial reagent, though 
ol t > 1 is possible (there may be several copies of for example 3 A —» 
2 B + C). This explains the notion of the reaction without interaction of 
different substances. 

For the mass action law (2.67) kinetic equations for the kinetic scheme 
(14.4) have a form 

^ a rKC + J2f3rikrC?; , K > 0 . (14.5) 

r : i=i r r 

Let there exist a positive balance for the reaction scheme (14.4): 

bi r (%r — ^ ^ bj Prj 
3 

for some bi > 0 and all r. In this case kinetic equations for the reaction 
system (14.4) have a Lyapunov norm [304]. This is the weighted l 1 norm: 
\\x\\ = JT bi\xi\, where bi > 0 are the coefficients from the linear conservation 
law J2i bi c i = const. There exists no quadratic Lyapunov norm for general 
reaction systems without interaction of different substances. 

Let us call a reaction mechanism dissipative , if it allows a universal Lya¬ 
punov norm 1 , that is, the Lyapunov norm which is independent of reaction 
rate constants. 

The reaction mechanism with only one elementary reaction, 

52 a * Ai ~* X! fc Ai * ( 14 - 6 ) 

i i 

is dissipative if and only if for any i if ai > 0, then cti > fy. 


1 For the motion on the planes with given values of the linear conservation laws. 
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The reaction mechanism with two elementary reaction without autocatal¬ 
ysis ( OL r i X fl ri = 0), 


Y i a ri A i ^Y / l3 ri A i ,(r = 1,2) (14.7) 

i i 


is not dissipative if and only if for two of components A{,Aj at least one of 
the following conditions holds: 

1. Branching 

aii,/3ij,a 2 j,f3 2 i >0, — — > 1 , (14.8) 

OLu a 2 j 

2 . Loss disproportion 

n Oi\% / a 

aii,aij,ot2i,Oi2j > 0, - A - 5 (14.9) 

Oil j Oi 2 j 

3. Gain-loss connection 

otu, ccij,a 2 i, (3 2 j >0, — — > 1 . (14.10) 

OLlj &2i 

These elementary obstacles to dissipativity alow to prove the non-dissipativity 
of many reaction mechanisms. 

It is possible to describe all the dissipative reaction mechanisms. For 
example, for three components A\,A 2 ,A 3 with the linear conservation law 
c\ + c 2 + C 3 = const, for bounded stoichiometric numbers (a^, (3 r i < 3), and 
without autocatalysis (a r i x /3 r i = 0 ) there are three such maximal mecha¬ 
nisms, and any other dissipative mechanism is a subset of one of these max¬ 
imal schemes (may be after permutation of the components) [305]. The first 
maximal scheme consists of all the reactions without interaction of different 
substances and with given conservation law: 

OL r Ai r —> f3 r iAi + (d r2 A 2 + /3 r 3^4-3, a r < 3, f3 r \ + (3 r2 + (3 r 3 = a r . (14.11) 

The corresponding Lyapunov norm is ||c|| = |ci| + \c 2 \ + |c 3 1. 

The second maximal scheme includes a reaction with interaction of dif¬ 
ferent substances, A\ + A 2 —>> 2A 3 \ 

A\ —>• A 2 , Ai —> As, A 2 —> Ai, A 2 » As , 

2^4i —> A 2 + As, 2A 2 —> A\ + As, 2,As —> Ai + A 2 , 

3Ai —> A 2 + 2 A 3 , 3Ai —> 2A 2 + ^. 3 , 3A 2 —> A\ + 2 A 3 , 3^4.2 — > 2Ai + As , 
A 1 +A 2 ^2A 3 . (14.12) 

The corresponding norm is ||c|| = \ci \ + |c 2 1 + |ci + C 2 + c 3 \. 

The third maximal scheme includes another reaction with interaction of 
different substances, A\ + 2^2 —> 3 ^ 3 : 
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A i — > A 2 , Ai — > A 3 , A 2 —> A 3 , 

2Ai —> A 2 + A 3 , 2A 2 —> Ai + A 3 , 

SAi —> A 2 + 2A 3 , 3Ai —> 2A 2 + A 3 , 3A 2 —> A\ + 2A 3 , 3A 3 —> Ai + 2A 2 , 
Ai + 2A 2 —> 3A 3 . (14.13) 

The corresponding norm is ||c|| = 2|ci| + \c 2 \ + |ci + c 2 + c 3 |. 


14.3 Examples: Infinite-Dimensional Systems 
With Finite-Dimensional Attractors 

In this section we list some of known examples of infinite-dimensional systems 
that are /c-contractions (that is, they contract ^-dimensional volume for some 
k) and have finite-dimensional attractors. 

The most celebrated example are the Navier-Stokes equations for incom¬ 
pressible fluid in a bounded domain Q of R 3 or R 2 : 


divu = 0 , 

Du 

— + (ix, V)u - i/A u + Vp = f , (14.14) 

where u(x,t) is the velocity field, v is the kinematic viscosity, A = V 2 is the 
Laplace operator, ( , ) is the standard inner product, p is the pressure, / is 
the volume force (normalized to unit density). 

The two main cases are studied, the flow with the Dirichlet boundary 
conditions u = 0 on <9i?, or the flow with periodic boundary conditions. 

For three-dimensional flows it is possible to prove conditional theorems 
of such a kind [313]: If A is a bounded attractor, then 

Dh(X) < const Re 3 , (14.15) 

where const is an universal constant and Re is the Reynolds number. The 
usual definition of Re is 

Re = , (14.16) 

where L and U are the reference length and reference velocity. 

There is no natural “typical velocity” in a turbulent flow and therefore 
there is no obvious unique choice of the Reynolds number. The different 
versions of the Reynolds numbers are discussed, for instance, in [313,314]. 

The classical physical estimate of the number of degrees of freedom for 
flows with large Reynolds numbers is ^Re 9 ^ 4 [315]. This estimate was ob¬ 
tained mathematically rigorously for the homogeneous decaying turbulence 
[316]. That is, for the Navier-Stokes equations without a forse / and after a 
special time-dependent transformation of space and time scales. 
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For two-dimensional flows it is possible to prove the existence of attrac¬ 
tors, because in this case the situation with existence and uniqueness of so¬ 
lutions is much more clear. There is a family of estimates of attractor dimen¬ 
sion [318]. The simplest and at the same time most important form of such 
an estimate is 

D h {X) < const (G + 1) , (14.17) 

where G is the generalized Grashof number: 


r 2 ||/|| 


(14.18) 


||/|| is the L 2 -norm of f in 12, L is the reference length. Of course, this 
definition allows some useful variations, as well, as the Reynolds number. 

For special classes of solutions these estimates could be made more precise. 
For example, for the boundary and pressure-gradient driven incompressible 
fluid flows in elongated two-dimensional channels the following estimates of 
the dimension of the attractor for the solutions of the Navier-Stokes equations 
are obtained [320]. For boundary driven shear flows and flux driven channel 
flows the upper bounds for the degrees of freedom was found in the form 
c<aRe 3 / 2 where c is a universal constant, a denotes the aspect ratio of the 
channel (length/width), and Re is the Reynolds number based on the channel 
width and the imposed “outer” velocity scale. For fixed pressure gradient 
driven channel flows an upper bound of form d Re 2 was obtained, where d 
is another universal positive constant and the Reynolds number is based on 
a velocity defined by the infimum, over all possible trajectories, of the time 
averaged mass flux per unit channel width. 

The estimates of the global attractor dimension were obtained for so-called 
generalized Navier-Stokes equations characterized by polynomial dependence 
between the stress tensor and the symmetric velocity gradient [319]. 

The maximal attractor X for the complex Ginzburg-Landau equation pe¬ 
riodic on the interval [0,1] 

r)A r) 2 A 

_ = RA + (l + iv)—-(l+i^)A\A\ 2 (14.19) 

has a finite dimension [321,322]: 

- For \/jl\ < y/3 

D h (X) < 2V3(R 1/2 /2ir) + 1 ; 

- For \fi\ > y/3 


D h (X) < (a/3/7 t)\h\R + 3\fj,\ 1/2 R 1/2 /2n + 2 . 


The Kuramoto-Sivashinsky equation was invented in order to describe 
waves in chemically reacting media: 
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1 

— = -uA 2 c -Ac- -(Vc) 2 . (14.20) 

where v > 0 and A is the Laplace operator. The term —Ac in the right 
hand side of this equation describes the negative diffusion, and the solutions 
remain regular due to the term —uA 2 c. 

The global dynamical properties of the Kuramoto-Sivashinsky equation 
were studied in [323]. In particular, in the one-dimensional case for even 
solutions with the L-periodic boundary conditions, the following estimate for 
the dimension of the attractor X which includes all bounded attractors was 
obtained: 

D h (X) < 5.4L 13/8 , (14.21) 

where L = L/{2iry/u) is the dimensionless size of the box (or of the “pattern 
cell”). 

For the two- and three-dimensional cases the estimations of attractor 
dimension include an a priori estimate of the L 2 norm of the c gradient 
R = hnp—^oo||Vc(t)|| [323]. 

Dynamics of the nonlocal Kuramoto-Sivashinsky equation (in the one¬ 
dimensional case) was studied in [324] 

dc d 4 c d 2 c dc / d 3 c\ 

dt dx 4 dx 2 ° dx a \dx 3 ) 

where a > 0, and 

hu) = - [ > ( i4 - 23 ) 

(the integral is understood in the sense of the Cauchy principle value). This 
equation arises in the modeling of the flow of a thin film of viscous liquid 
down an inclined plane in electric field. 

For large a and l the obtained attractor dimension estimate is 

D h (X) < 0(a 3/2 Z 3 / 2 + L 2 ) . (14.24) 

The Cahn-Hilliard equation describes the evolution of a conserved con¬ 
centration field during phase separation: 

dc 

— = A(—z/Ac + /(c)) , (14.25) 

where /(c) is a polynomial of an odd order. Usually, /(c) = — ac + /3c 3 , 
a, /? > 0. Like the Kuramoto-Sivashinsky equation, the Cahn-Hilliard equa¬ 
tion contains the regularizing term —nA 2 c and the negative diffusion term 
—aAc in the right hand side. The operator —uA 2 effectively suppresses the 
short waves (with the logarithmic decrement for the wave vector fc); 
it allows to prove the existence of the finite-dimensional attractors and to 
estimate their dimensions for various hypothesis about / and boundary con¬ 
ditions [325-329]. The Cahn-Hilliard equation can be presented as a gradient 
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system that minimizes the free energy (possibly, to a local minimum). Hence, 
the limiting behavior of this system is rather simple; it always tends to a 
stationary point (to the stable or metastable equilibrium). 

It should be stressed that the maximal attractor (4.1) 

x = f) Tt(Y) , 

t>o 

where Y is the positively invariant absorbing set, and T t is the map of the 
phase flow (the shift operator for the time £), estimates the limit behavior 
from above and often does not satisfy the intuitive expectation (that is, it is 
too large). For example, if the absorbing set Y includes a saddle point then 
the corresponding maximal attractor X includes the whole unstable manifold 
of this point, and the dimension of X is not less than the dimension of this 
unstable manifold. For instance, when all the solutions tend to fixed points 
from a finite set, the dimension of maximal attractor might be nonzero and 
rather large. Therefore, the study of the structure of the attractor becomes 
important. For the viscous Cahn-Hilliard equation 

(! ~ a )% = A (- z/Ac + /( c ) + q; ^) > (14.26) 

with usual no-flow boundary conditions the structure of the global attractor 
was studied in [330] (for the one-dimensional case). The dimension of the 
unstable manifolds was calculated for all stationary states. In the unstable 
case, the flow on the global attractor is shown to be semi-conjugate to the 
flow of the global attractor of the Chaffee-Infante equation 

5 = S + ^(c-c=) (“ 27 > 

with zero boundary conditions. The connection between these equations is in 
accordance with their physical sense [331,332]. 

In the reaction-diffusion equations the only source of instabilities can be 
the reaction part. The diffusion suppresses short waves (with the logarithmic 
decrement ~k 2 for wave vector k). Let us consider the following system in 
a bounded domain £2 C R n with the zero or non-flow boundary conditions 
[333,335]: 

Be 

— = vdAc - /(c) + g{pc) , (14.28) 

where c(x,t) = (c 1 ,... ,c N ), v > 0, d = dij is a real N x N matrix with 
positive symmetric part (d+d + )/2 > 1, /(c) = (/ 1 (c),..., f N (c)), and g(x) = 
(g 1 (x ),..., g N (x)). Here, /(c) is the reaction part, and g{x) describes the 
external sources and sinks. 

Let /(c) be a smooth map, D c f(e ) = (df l /dc?), and the following condi¬ 
tions hold 
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E^r -Ci< (c,/(c)) ; 


(14.29) 


Ei/W*^ £pr + i 


(14.30) 


i \ i 


( D c f(c)w,w ) > —C 73 |-w | 2 , 


(14.31) 


for some 61 , 62,63 > 0 , 7 $ > 0 > 2 , 1/pi + 1/qi = 1 , any c and all 

w E Then the dimension of the attractor X for (14.28) admits the 
following estimate: 



(14.32) 


where n is the space dimension, \Q\ is the measure of Q C R n , and co(fi) 
depends on the shape of Q only, that is, co(Ai?) = co(b?) for all A > 0 . 
The constant 63 estimates the possible increment of the kinetic trajectories 
instability from above. 

The reaction-diffusion systems remain the basic example of the finite- 
dimension volumes contractions, because of transparent structure: the dif¬ 
fusion generates contraction (with the logarithmic decrement ~k 2 for wave 
vector fc), and the reaction can cause finite-dimensional instabilities. It is 
well-studied, see, for instance, [318,333-336]. 

For the dissipative wave equations the estimates of attractor dimensions 
were found in [333,337-339] and discussed in [318,335]. Let us consider the 
following equation in a bounded domain i? C R n 



(14.33) 


with zero boundary conditions. This equation contains the damping term 
with 7 > 0. The essential difference between (14.33) and the reaction- 
diffusion equations (14.28) is in the character of dissipation. According to the 
dissipative wave equations short waves decay as exp(—y£), the logarithmic 
decrement has the constant limit for k 2 —> 00 . It is the same situation, as 
for the Grad equations (see Chap. 8 ), or for the model kinetic equations (see 
Chap. 2 ). 

Let 0 < Ai < A 3 < A 4 < ... be the eigenvalues of the operator —A in 
Q with zero boundary conditions (in the order of their values). Assume that 
g E L 2 (Q) and the smooth function f(u) satisfies the following conditions for 


any u 


F(u) > — mu 2 — Cm ; 
f(u)u - <;F(u) + mu 2 > -C m ; 
\f' u {u)\ < C 0 (l + \u\ p ) , 


(14.34) 

(14.35) 

(14.36) 
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where F(u) = f(v) &v, Ai > m > 0 , > 0 , C m and Co are some constants, 

2/(n — 2) > p > 0 for n > 3, and p > 0 is an arbitrary positive number for 
n = 1 , 2 . 

The important examples of (14.33) give the nonlinearities 

f(u) = /3smu 


and 

/(") = f3\u\ p u . 

In order to present more explicit expressions for dimension estimates let 
us restrict ourselves by the sin-Gordon equation with f(u) = /3sinu. More 
general consideration can be found elsewhere (see, for example, [318,335]). 
Let us introduce the following dimensionless numbers: 

/ 3 2 

j -b' D= l (i4 ' 37 > 

For the sin-Gordon equation the dimension estimate of the attractor is 
Dh(X) < ra, where the number m (see [318], p. 364) is the first integer such 
that 

m 

m > 2 7 Ai^A“ 1 J (1 + j D 2 ) . (14.38) 

i= 1 

For large i, ^ constAii 2 / 72 , hence, for all i, Ai/A i < const i _2 / n , 


m 



Ai ^ A i 1 < Cm 1 « 

2 — 1 

(14.39) 

for n > 2 , 

777 , 



Ai ^ A ^ 1 < Clnm 

i=l 

(14.40) 

for n = 2 , and 




7 — 1 

(14.41) 

for n = 1. Here, in (14.39)-(14.40) constants depend only on the shape of Q. 
Following these inequalities we can take as the upper dimension estimate the 
first integer m such that 


m > (2 7 (7J(1 + D 2 ))"/ 2 

(14.42) 

for n > 2 , 

to > 2 7 CJ(1 + D 2 ) In to 

(14.43) 

for n = 2 , and 

to > 2 7 CJ(1 + D 2 ) 

(14.44) 


for n = 1 . 
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The estimates for attractor dimension were also obtained for some other 
systems: thermohydraulics (including the Boussinesq equation), magnetohy¬ 
drodynamics (see [318]), the Smoluchowski equation arising in the modeling 
of nematic liquid crystalline polymers [340], and others. Various dimensions 
(not only the Hausdorff dimension) were estimated. 


14.4 Systems with Inheritance: 

Dynamics of Distributions with Conservation 

of Support, Natural Selection 

and Finite-Dimensional Asymptotics 

14.4.1 Introduction: Unusual Conservation Law 

In the 1970th-1980th years, theoretical studies developed one more “com¬ 
mon” field belonging simultaneously to physics, biology and mathematics. 
For physics it is (so far) a part of the theory of approximations of a special 
kind, demonstrating, in particular, interesting mechanisms of discreteness in 
the course of evolution of distributions with initially smooth densities. But 
what for physics is merely a convenient approximation, is a fundamental law 
in biology (inheritance), whose consequences comprehended informally (se¬ 
lection theory [115,377-380,383,384] ) 2 permeate most of the sections of this 
science. 

Consider a community of animals. Let it be biologically isolated. Muta¬ 
tions can be neglected in the first approximation. In this case new genes do 
not emerge. 

And here is an example is from physics. Let waves with wave vectors k be 
excited in some system. Denote K a set of wave vectors k of excited waves. 
Let the waves interaction do not lead to generation of waves with new k £ K. 
Such an approximation is applicable to a variety of situations. For the wave 
turbulence it was described in detail in [385,386]. 

What is common in these examples is the evolution of a distribution with 
a support not increasing in time. 

What does not increase must, as a rule, decrease, if the decrease is not 
prohibited. This naive thesis can be converted into rigorous theorems for the 
case under consideration [115]. The support is proved to decrease in the 
limit t —» oo, if it was sufficiently large initially. Considered usually are such 
system, for which at finite times the distributions support conserves and 
decrease only in the limit t —> oo. Conservation of the support usually results 
in the following effect: dynamics of initially infinite-dimensional system at 
t —> oc can be described by finite-dimensional systems. 

2 We do not try to review the scientific literature about the evolution, and mention 
here only the references that are especially important for our understanding of 
the selection theory and applications. 
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The simplest and most common in applications class of equations for 
which the distributions support does not grow in time, is constructed as 
follows. To each distribution q is assigned a function by which the distri¬ 
bution can be multiplied. Written down is equation 



(14.45) 


The multiplier k M is called a reproduction coefficient. The right-hand side 
is the product of the function k M with the distribution q, hence dq/d£ should 
be zero where q is equal to zero, therefore the support of q is conserved in 
time (over the finite times). 

Let us remind the definition of the support. Each distribution on a com¬ 
pact space X is a continuous linear functional on the space of continuous 
functions C(X) 3 . The space C(X) is the Banach space endowed with the 
norm 


ll/ll = max 1/0*01 • 

xEX 


(14.46) 


Usually, when X is a bounded closed subset of a finite-dimensional space, we 
represent this functional as the integral 



where ffix) is the (generalized) density function of the distribution q. The 
support of q, suppq, is the smallest closed subset of X with the following 
property: if f(x) = 0 on suppq, then q[/] = 0 , i.e. q(x) = 0 outside suppq. 

Strictly speaking, the space on which q is defined and the distribution 
class it belongs to, should be specified. One should also specify are properties 
of the mapping q i—► k^ and answer the question of existence and uniqueness 
of solutions of (14.45) under given initial conditions. In specific situations the 
answers to these questions are not difficult. 

Let us start with the simplest example 



(14.47) 


where the functions ffi ( x ) and fi ( x ) are positive and continuous on the closed 
segment [a, b]. Let the function fo{x) reaches the global maximum on the 
segment [a, b] at a single point xq. If xq E suppq(x,0), then 



(14.48) 


3 We follow the Bourbaki approach [393]: a measure is a continuous functional, an 
integral. The book [393] contains all the necessary notions and theorems (and 
much more material than we need here). 
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where S(x — xq) is the ^-function. 

We use in the space of measures the weak convergence , i.e. the convergence 
of averages: 



(14.49) 


for all continuous functions ip(x). This weak convergence of measures gen¬ 
erates the weak topology on the space of measures (the weak topology of 
conjugated space). 

If fo(x) has several global maxima, then the right-hand side of (14.48) can 
be a sum of a finite number of ^-functions. Here a natural question arises: is it 
worth to pay attention to such a possibility? Should not we deem improbable 
for fo(x) to have more than one global maximum? Indeed, such a case seems 
to be very unlikely to occur. More details about this are given below. 

Equations in the form (14.45) allow the following biological interpretation: 
is the distribution of the number (or of a biomass, or of another extensive 
variable) over inherited units: species, varieties, supergenes, genes. Whatever 
is considered as the inherited unit depends on the context, on a specific prob¬ 
lem. The value of k^(x) is the reproduction coefficient of the inherited unit 
x under given conditions. The notion of “given conditions” includes the dis¬ 
tribution /x, the reproduction coefficient depends on fi. Equation (14.47) can 
be interpreted as follows: fo(x) is the specific birth-rate of the inherited unit 
x (below, for the sake of definiteness, x is a variety, following the spirit of 
the famous Darwin’s book [377]), the death rate for the representatives of 
all inherited units (varieties) is determined by one common factor depending 
on the density fi(x)/i(x, t) dx; fi(x) is the individual contribution of the 
variety x into this death-rate. 

On the other hand, for systems of waves with a parametric interac¬ 
tion, k /Jj (x) can be the amplification (decay) rate of the wave with the wave 
vector x. 

The first step in the routine of a dynamical system investigation is the 
question about fixed points and their stability. And the first observation 
concerning the system (14.45) is that asymptotically stable can be only 
the steady-state distributions, whose support is discrete (i.e. the sums of 
^-functions). This can be proved for all the consistent formalizations, and 
can be understood as follows. 

Let the “total amount” (integral of |/x| over U ) be less than e > 0 but 
not equal to zero in some domain U. Substitute distribution /x by zero on 
I/, the rest remains as it is. It is natural to consider this disturbance of /a 
as 5-small. However, if the dynamics is described by (14.45), there is no way 
back to the undisturbed distribution, because the support cannot increase. If 
the steady state distribution /x* is asymptotically stable, then for some 5 > 0 
any 5-small perturbation of /x* relaxes back to /x*. This is possible only in 
the case if for any domain U the integral of |/x*| over U is either 0 or greater 
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than e. Hence, this asymptotically stable distribution (i* is the sum of the 
finite number of ^-functions: 



(14.50) 


with \Ni\ > £ for all i. 

So we have: the support of asymptotically stable distributions for the 
system (14.45) is always discrete. This simple observation has many strong 
generalizations to general o;-limit points, to equations for vector measures, 
etc. 

Dynamic systems where the phase variable is a distribution /x, and the 
distribution support is the integral of motion, frequently occur both in physics 
and in biology. Because of their attractive properties they are frequently used 
as approximations: we try to find the “main part” of the system in the form 
(14.45), and represent the rest as a small perturbation of the main part. 

In biology such an approximation is essentially all the classical genetics, 
and also the formal contents of the theory of natural selection. The initial 
diversity is “thinned out” in time, and the limit distribution supports are 
described by some extremal principles (principles of optimality). 

Conservation of the support in equation (14.45) can be considered as 
inheritance, and, consequently, we call the system (14.45) and its nearest 
generalizations “systems with inheritance”. Traditional division of the process 
of transferring biological information into inheritance and mutations, small 
in any admissible sense, can be compared to the description according to 
the following pattern: system (14.45) (or its nearest generalizations) plus 
small disturbances. Beyond the limits of such a description, talking about 
inheritance loses the conventional sense. 

The first study of the dynamics systems with inheritance was due to 
J.B.S. Haldane. He used the simplest examples, studied steady-state distri¬ 
butions, and obtained the extremal principle for them. His pioneering book 
“The Causes of Evolution” (1932) [378] gives the clear explanation of the con¬ 
nections between the inheritance (the conservation of distributions support) 
and the optimality of selected varieties. 

Haldane’s work was followed by entirely independent series of works on the 
S-approximation in the spin wave theory and on the wave turbulence [385- 
387], which studied wave configurations in the approximation of “inherited” 
wave vector, and by “Synergetics” [392], where the “natural selections” of 
modes is one of the basic concepts. 

At the same time, a series of works on biological kinetics was done (see, for 
example, [115,381-383]). The studies addressed not only steady-states, but 
also common limit distributions [115,382] and waves in the space of inherited 
units [381]. For the steady-states a new type of stability was described - the 
stable realizability (see below). 
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The purpose of this paper is to present general results of the theory of 
systems with inheritance: optimality principles the for limit distributions, 
theorems about selection, and estimations of the limit diversity (estimates of 
number of points in the supports of the limit distributions), drift effect and 
drift equations. Some of these result were published in preprints in Russian 
[382] (and, partially, in the Russian book [115]). 

14.4.2 Optimality Principle for Limit Diversity 

Description of the limit behavior of a dynamical system does not necessarily 
reduce to enumerating stable fixed points and limit cycles. The possibility 
of stochastic oscillations is common knowledge, while the domains of struc¬ 
turally unstable (non coarse) systems discovered by S. Smale [394 ] 4 have so 
far not been mastered in applied and natural sciences). 

The leading rival to adequately formalize the limit behavior is the concept 
of the “a;-limit set”. It was discussed in detail in the classical monograph [395]. 
The fundamental textbook on dynamical systems [396] and the introductory 
review [397] are also available. 

If fit) is the dependence of the position of point in the phase space on 
time t (i.e. the motion of the dynamical system), then the cj-limit points are 
such points y, for which there exist such sequences of times £$—> 00 , that 


f(U) -> y- 


The set of all cj-limit points for the given motion f(t) is called the co- 
limit set. If, for example, fit) tends to the equilibrium point y* then the 
corresponding cj-limit set consists of this equilibrium point. If f(t) is winding 
onto a closed trajectory (the limit cycle), then the corresponding cj-limit set 
consists of the points of the, cycle and so on. 

General cj-limit sets are not encountered oft in specific situations. This 
is because of the lack of efficient methods to find them in a general situa¬ 
tion. Systems with inheritance is a case, where there are efficient methods to 
estimate the limit sets from above. This is done by the optimality principle. 

Let fjb(t) be a solution of (14.45). Note that 



(14.51) 


4 “Structurally stable systems are not dense”. Without exaggeration we can say 
that so entitled work [394] opened a new era in the understanding of dynam¬ 
ics. Structurally stable (rough) systems are those whose phase portraits do not 
change qualitatively under small perturbations. Smale constructed such struc¬ 
turally unstable system that any other system close enough to it is also struc¬ 
turally unstable. This result defeated hopes for a classification if not all, but 
at least “almost all” dynamical systems. Such hopes were associated with the 
success of the classification of two-dimensional dynamical systems, among which 
structurally stable systems are dense. 
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Here and below we do not display the dependence of distributions fi and of 
the reproduction coefficients k on x when it is not necessary. Fix the notation 
for the average value of £^( r ) on the segment [0, t] 

( k ^(t))t *V(t) dr . (14.52) 

Then the expression (14.51) can be rewritten as 

n(t) = Mo) exp (t{k^ t) )t) . (14.53) 

If [T is the cj-limit point of the solution //(£), then there exists such a 
sequence of times ti — > oo, that —> /T. Let it be possible to chose a 

convergent subsequence of the sequence of the average reproduction coeffi¬ 
cients which corresponds to times U. We denote as k* the limit of 

this subsequence. Then, the following statement is valid: on the support of 
/ 1 * the function k* vanishes and on the support of /i(0) it is non-positive: 

k*(x) = 0 if x G supp/i* , 

k*(x) < 0 if x G supp/i(0) . (14.54) 

Taking into account the fact that supp/i* C supp/i(0), we come to the 
formulation of the optimality principle (14.54): The support of limit dis¬ 
tribution consists of points of the global maximum of the average reproduction 
coefficient on the initial distribution support. The corresponding maximum 
value is zero. 

We should also note that not necessarily all points of maximum of fc* 
on supp/i(0) belong to supp/r*, but all points of supp/r* are the points of 
maximum of k* on supp/r(0). 

If /a(t) tends to the fixed point //*, then {k^fjt —> k as t —> oo, and 
supp/r* consists of the points of the global maximum of the corresponding re¬ 
production coefficient k on the support of fT. The corresponding maximum 
value is zero. 

If ii(t) tends to the limit cycle n*(t) (/x*(t + T) = M*(^)), then all the 
distributions //*(£) have the same support. The points of this support are the 
points of maximum (global, zero) of the averaged over the cycle reproduction 
coefficient ^ 

k* = (V(f))T = f j Q Vm dr ’ (14.55) 

on the support of /i(0). 

The supports of the cj-limit distributions are specified by the functions 
k*. It is obvious where to get these functions from for the cases of fixed 
points and limit cycles. There are at least two questions: what ensures the 
existence of average reproduction coefficients at t —> oo, and how to use the 
described extremal principle (and how efficient is it). The latter question is 
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the subject to be considered in the following sections. In the situation to 
follow the answers to these questions have the validity of theorems. Let X be 
a space on which the distributions are defined. Assume it to be a compact 
metric space (for example, a closed bounded subset of Euclidian space). The 
distribution /a is identified with the Radon measure, that is the continuous 
linear functional on the space of continuous functions on X,C(X). We use the 
conventional notation for this linear functional as the integral of the function 
as J ip(x)/jb(x) dx. Here fi(x) is acting as the distribution density, although, 
of course, the arbitrary X has no initial (Lebesgue, for example) dx. 

The sequence of continuous functions ki (x) is considered to be convergent 
if it converges uniformly. The sequence of measures /i* is called convergent 
if for any continuous function ip(x) the integrals f <p(x)/ii(x) dx converge 
(weak convergence (14.49)). The mapping (i i—► assigning the reproduction 
coefficient k M to the measure /x is assumed to be continuous. And, finally, the 
space of measures is assumed to have a bounded 5 set M which is positively 
invariant relative to system (14.45): if /x(0) G M, then /x(£) G M (and is 
non-trivial). This M will serve as the phase space of system (14.45). 

Most of the results about systems with inheritance use the theorem 
about weak compactness: The bounded set of measures is precompact with 
respect to the the weak convergence (i.e., its closure is compact). Therefore, 
the set of corresponding reproduction coefficients kM = {/qj/x £ M} is pre¬ 
compact, the set of averages (14.52) is precompact, because it is the subset 
of the closed convex hull couv(A:m) of the compact set. This compactness 
allows us to claim the existence of the average reproduction coefficient k * for 
the description of the o;-limit distribution /T with the optimality principle 
(14.54). 


14.4.3 How Many Points 

Does the Limit Distribution Support Hold? 

The limit distribution is concentrated in the points of (zero) global maxi¬ 
mum of the average reproduction coefficient. The average is taken along the 
solution, but the solution is not known beforehand. With the convergence 
towards a fixed point or to a limit cycle this difficulty can be circumvented. 
In the general case the extremal principle can be used without knowing the 
solution, in the following way [115]. Considered is a set of all dependencies 
/x(£) where fi belongs to the phase space, the bounded set M. The set of all 
averages over t is {(^(t))t}« Further, taken are all limits of sequences formed 
by these averages - the set of averages is closed. The result is the closed 
convex hull con v(&m) of the compact set &m- This set involves all possible 
averages (14.52) and all their limits. In order to construct it, the true solution 
/x(£) is not needed. 

5 The set of measures M is bounded, if the sets of integrals {/x[/]|/x G M, ||/|| < 1} 
is bounded, where ||/|| is the norm (14.46). 
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The weak optimality principle is expressed as follows. Let fi{t) be a solu¬ 
tion of (14.45) in M, /i* is any of its cj-limit distributions. Then in the set 
conv(&M) there is such a function k* that its maximum value on the support 
supp/ro of the initial distribution /j,q equals to zero, and supp/r* consists of 
the points of the global maximum of k* on supp/io only (14.54). 

Of course, in the set conv(& m) usually there are many functions that are 
irrelevant to the time average reproduction coefficients for the given motion 
fi{t). Therefore, the weak extremal principle is really weak - it gives too 
many possible supports of pi*. However, even such a principle can help to 
obtain useful estimates of the number of points in the supports of o;-limit 
distributions. 

It is not difficult to suggest systems of the form (14.45), in which any 
set can be the limit distribution support. The simplest example: k^ = 0. 
Here o;-limit (fixed) is any distribution. However, almost any arbitrary small 
perturbation of the system destroys this pathological property. 

In the realistic systems, especially in biology, the coefficients fluctuate and 
are never known exactly. Moreover, the models are in advance known to have 
a finite error which cannot be exterminated by the choice of the parameters 
values. This gives rise to an idea to consider not individual systems (14.45), 
but ensembles of similar systems [115]. 

Having posed the questions of how many points can the support of cj-limit 
distributions have, estimate the maximum for each individual system from 
the ensemble (in its cj-limit distributions), and then, estimate the minimum 
of these maxima over the whole ensemble - ( the minimax estimation ). The 
latter is motivated by the fact, that if the inherited unit has gone extinct 
under some conditions, it will not appear even under the change of conditions. 

Let us consider an ensemble that is simply the e- neighborhood of the given 
system (14.45). The minimax estimates of the number of points in the support 
of o;-limit distribution are constructed by approximating the dependencies k M 
by finite sums 

n 

= yo{x) + Tj • (14.56) 

i =1 

Here ipi depend on x only, and V’z depend on pi only. Let e n > 0 be the 
distance from k M to the nearest sum (14.56) (the “distance” is understood 
in the suitable rigorous sense, which depends on the specific problem). So, 
we reduced the problem to the estimation of the diameters e n > 0 of the set 
con v(k M )- 

The minimax estimation of the number of points in the limit 
distribution support gives the answer to the question, “How many points 
does the limit distribution support hold ”: If e > e n then, in the e-vicinity 
of kjj, the minimum of the maxima of the number of points in the u-limit 
distribution support does not exceed n. 

In order to understand this estimate it is sufficient to consider system 
(14.45) with k M of the form (14.56). The averages (14.52) for any dependence 
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fi{t) in this case have the form 


1 ft n 

(k^t))t = ~ k Kr) dr = tp Q (x) + W x )a* . 
1 J o ,, 


(14.57) 


where cq are some numbers. The ensemble of the functions (14.57) for various 
cii forms a n-dimensional linear manifold. How many of points of the global 
maximum (equal to zero) could a function of this family have? 

Generally speaking, it can have any number of maxima. However, it seems 
obvious, that “usually” one function has only one point of global maximum, 
while it is “improbable” the maximum value is zero. At least, with an arbi¬ 
trary small perturbation of the given function, we can achieve for the point 
of the global maximum to be unique and the maximum value be non-zero. 

In a one-parametric family of functions there may occur zero value of the 
global maximum, which cannot be eliminated by a small perturbation, and 
individual functions of the family may have two global maxima. 

In the general case we can state, that “usually” each function of the 
n-parametric family (14.57) can have not more than n — 1 points of the 
zero global maximum (of course, there may be less, and for the majority of 
functions of the family the global maximum, as a rule, is not equal to zero at 
all). What “usually” means here requires a special explanation given in the 
next section. 

In application k M is often represented by an integral operator, linear or 
nonlinear. In this case the form (14.56) corresponds to the kernels of inte¬ 
gral operators, represented in a form of the sums of functions’ products. For 
example, the reproduction coefficient of the following form 


k^ = ip 0 (x) + J K{x,y)n{y) d y, 


n 

where K(x, y ) = E Vi{x)gi(y ), 

i= 1 


(14.58) 


has also the form (14.56) with ^(/x) = fgi(y)y(y) d y. 

The linear reproduction coefficients occur in applications rather fre¬ 
quently. For them the problem of the minimax estimation of the number 
of points in the cj-limit distribution support is reduced to the question of 
the accuracy of approximation of the linear integral operator by the sums of 
kernels-products (14.58). 


14.4.4 Selection Efficiency 

The first application of the extremal principle for the cj-limit sets is the 
theorem of the selection efficiency. The dynamics of a system with inheritance 
indeed leads in the limit t —> oc to a selection. In the typical situation, a 
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diversity in the limit t —> oo becomes less than the initial diversity. There is an 
efficient selection for the “best”. The basic effects of selection are formulated 
below. 

Theorem of Selection Efficiency 

1. Almost always the support of any u-limit distribution is nowhere dense in 
X (and it has the Lebesgue measure zero for Euclidean space). 

2. Let e n > 0, e n —» 0 be an arbitrary chosen sequence. The following state¬ 
ment is almost always true for system (14-45)- Let the support of the initial 
distribution be the whole X. Then the support of any u-limit distribution 
fT is almost finite. This means that it is approximated by finite sets faster 
than e n —> 0; for any S > 0 there is such a number N that for any uj- 
limit distribution g* there exists a finite set Sn of N elements such that 
dist(Sjv> supp/r*) < dsjsr, where dist is the Hausdorff distance: 

dist(A, F>) = maxjsup inf p{x,y), sup inf p{x,y)} , (14.59) 

xeA x ^ B xeB x ^ A 

where p{pc , y) is the distance between points. 

3. In the previous statement for any chosen sequence e n > 0, e n —■> 0, almost 
all systems (14-45) have uj- limit distributions with supports that can be 
approximated by finite sets faster than £ n —> 0. The order is important: 
u for any sequence almost all systems... ” But if we use only the recursive 
(algorithmic) analogue of sequences, then we can easily prove the state¬ 
ment with the reverse order: “almost all systems for any sequence... ” 
This is possible because the set of all recursive enumerable countable sets 
is also countable and not continuum. This observation is very important 
for algorithmic foundations of probability theory [398]. Let L be a set of 
all sequences of real numbers £ n > 0, £ n —► 0 with the property: for each 
{£n} £ L the rational subgraph {(n, r) : e n > r G Q} is recursively enu¬ 
merable. For almost all systems (14-45) and any {s n } £= L the support 
of any u-limit distribution g* is approximated by finite sets faster than 
£ n > 0. 

These properties hold for the continuous reproduction coefficients. It is 
well-known, that it is dangerous to rely on the genericity among continuous 
functions. For example, almost all continuous functions are nowhere differ¬ 
entiable. But the properties 1 and 2 hold also for the smooth reproduction 
coefficients on the manifolds and sometimes allow to replace the “almost 
finiteness” by simply finiteness. In order to appreciate this theorem, note 
that: 

1. Support of an arbitrary o;-limit distribution g* consist of points of global 
maximum of the average reproduction coefficient on a support of the initial 
distribution. The corresponding maximum value is zero. 

2. Almost always a function has only one point of global maximum, and 
corresponding maximum value is not 0. 
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3. In a one-parametric family of functions almost always there may occur zero 
values of the global maximum (at one point), which cannot be eliminated 
by a small perturbation, and individual functions of the family may stably 
have two global maximum points. 

4. For a generic n-parameter family of functions, there may exist stably a 
function with n — 1 points of global maximum and with zero value of this 
maximum. 

5. Our phase space M is compact. The set of corresponding reproduction 

coefficients in C(X) for the given map fi —» is compact too. The 

average reproduction coefficients belong to the closed convex hull of this 
set con v(/cm)- And it is compact too. 

6. A compact set in a Banach space can be approximated by its projection 
on an appropriate finite-dimensional linear manifold with an arbitrary 
accuracy. Almost always the function on such a manifold may have only 
n — 1 points of global maximum with zero value, where n is the dimension 
of the manifold. 

The rest of the proof is purely technical. The easiest demonstration of the 
“natural” character of these properties is the demonstration of instability of 
exclusions: If, for example, a function has several points of global maxima 
then with an arbitrary small perturbation (for all usually used norms) it can 
be transformed into a function with the unique point of global maximum. 
However “stable” does not always mean “dense”. In what sense the discussed 
properties of the system (14.45) are usually valid? “Almost always”, “typi¬ 
cally” , “generically” a function has only one point of global maximum. This 
sentence should be given an rigorous meaning. Formally it is not difficult, 
but haste is dangerous when defining “genericity”. 

Here are some examples of correct but useless statements about “generic” 
properties of function: Almost every continuous function is not differentiable; 
Almost every C 1 -function is not convex. Their meaning for applications is 
most probably this: the genericity used above for continuous functions or for 
C 1 -function is irrelevant to the subject. 

Most frequently the motivation for definitions of genericity is found in such 
a situation: given n equations with m unknowns, what can we say about the 
solutions? The answer is: in a typical situation, if there are more equations, 
than the unknowns (n > m), there are no solutions at all, but if n < m (n 
is less or equal to m), then, either there is a (m — n)-parametric family of 
solutions, or there are no solutions. 

The best known example of using this reasoning is the Gibbs phase rule 
in classical chemical thermodynamics. It limits the number of co-existing 
phases. There exists a well-known example of such reasoning in mathemat¬ 
ical biophysics too. Let us consider a medium where n species coexist. The 
medium is assumed to be described by m parameters. In the simplest case, 
the medium is a well-mixed solution of m substances. Let the organisms in¬ 
teract through the medium, changing its parameters - concentrations of m 
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substances. Then, in a steady state, for each of the coexisting species we have 
an equation with respect to the state of the medium. So, the number of such 
species cannot exceed the number of parameters of the medium. In a typical 
situation, in the m-parametric medium in a steady state there can exist not 
more than m species. This is the Gause concurrent exclusion principle [399]. 
This fact allows numerous generalizations. Theorem of the natural selection 
efficiency may be considered as its generalization too. 

Analogous assertion for a non-steady state coexistence of species in the 
case of equations (11) is not true. It is not difficult to give an example of sta¬ 
ble coexistence under oscillating conditions of n species in the m- parametric 
medium at n > m. But, if k M are linear functions of /i, then for non-stable 
conditions we have the concurrent exclusion principle, too. In that case, the 
average in time of reproduction coefficient k^ is the reproduction coeffi¬ 
cient for the average fi(t) because of linearity. Therefore, the equation for the 
average reproduction coefficient, 

k*(x) = 0 for x G supp/i* , (14.60) 

transforms into the following equation for the reproduction coefficient of the 
average distribution 

fc*((/i)) = 0 for x G supp/i* (14.61) 

(the Volterra averaging principle [400]). This system has as many linear equa¬ 
tions as it has coexisting species. The averages can be non-unique. Then all of 
them satisfy this system, and we obtain the non-stationary Gause principle. 
And again, it is valid “almost always”. 

Formally, various definitions of genericity are constructed as follows. All 
systems (or cases, or situations and so on) under consideration are somehow 
parameterized - by sets of vectors, functions, matrices etc. Thus, the “space 
of systems” Q can be described. Then the “thin sets” are introduced into Q, 
i.e. the sets, which we shall later neglect. The union of a finite or countable 
number of thin sets, as well as the intersection of any number of them should 
be thin again, while the whole Q is not thin. There are two traditional ways 
to determine thinness. 

1. A set is considered thin when it has measure zero. This is good for a 
finite-dimensional case, when there is the standard Lebesgue measure - 
the length, the area, the volume. 

2. But most frequently we deal with the functional parameters. In that case 
it is common to restore to the second definition, according to which the 
sets of first category are negligible. The construction begins with nowhere 
dense sets. The set Y is nowhere dense in Q, if in any nonempty open 
set V C Q (for example, in a ball) there exists a nonempty open subset 
W C V (for example, a ball), which does not intersect with Y. Roughly 
speaking, Y is “full of holes” - in any neighborhood of any point of the set 
Y there is an open hole. Countable union of nowhere dense sets is called 
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the set of the first category. The second usual way is to define thin sets as 
the sets of the first category. 

But even the real line R can be divided into two sets, one of which has 
zero measure, the other is of the first category. The genericity in the sense 
of measure and the genericity in the sense of category considerably differ 
in the applications where both of these concepts can be used. The conflict 
between the two main views on genericity stimulated efforts to invent new 
and stronger approaches. 

In Theorem of selection efficiency a very strong genericity was used. Sys¬ 
tems (14.45) were parameterized by continuous maps /i i—► k^. Denote by Q 
the space of these maps M —► C(X) with the topology of uniform convergence 
on M. So, it is a Banach space. We shall call the set Y in the Banach space 
Q completely thin , if for any compact set K in Q and arbitrary positive e > 0 
there exists a vector q E Q, such that ||g|| <6 and K + q does not intersect Y. 
So, a set, which can be moved out of intersection with any compact by an arbi¬ 
trary small translation, is completely negligible. In a finite-dimensional space 
there is only one such set - the empty one. In an infinite-dimensional Ba¬ 
nach space compacts and closed subspaces with infinite codimension provide 
us examples of completely negligible sets. In Theorem of selection efficiency 
“usually” means “the set of exceptions is completely thin”. 

14.4.5 Gromov’s Interpretation of Selection Theorems 

In his talk [401], M. Gromov offered a geometric interpretation of the selection 
theorems. Let us consider dynamical systems in the standard ra-simplex cr m 
in m + 1-dimensional space R rn+1 : 


ra+l 

°m = {% £ > 0 , ^ Xi = 1 } . 

i=l 

We assume that simplex a m is positively invariant with respect to these 
dynamical systems: if the motion starts in a m at some time to then it remains 
in a m for t > to- Let us consider the motions that start in the simplex cr m at 
t = 0 and are defined for t > 0. 

For large m, almost all volume of the simplex a m is concentrated in a 
small neighborhood of the center of cr m , near the point c = (^, 4^, ..., -T) . 
Hence, one can expect that a typical motion of a general dynamical system in 
cr m for sufficiently large m spends almost all the time in a small neighborhood 
of c. 

Let us consider dynamical systems with an additional property (“inher¬ 
itance”): all the faces of the simplex a m are also positively invariant with 
respect to the systems with inheritance. It means that if some Xi = 0 ini¬ 
tially at the time t = 0 then Xi = 0 for t > 0 for all motions in a m . The essence 
of selection theorems is as follows: a typical motion of a typical dynamical 
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system with inheritance spends almost all the time in a small neighborhood 
of low-dimensional faces, even if it starts near the center of the simplex. 

Let us denote by 9 r cr m the union of all r-dimensional faces of cr m . Due to 
the selection theorems, a typical motion of a typical dynamical system with 
inheritance spends almost all time in a small neighborhood of 9 r cr m with 
r C m. It should not obligatory reside near just one face from 9 r cr m , but can 
travel in neighborhood of different faces from 3 r cr m (the drift effect). The 
minimax estimation of the number of points in o;-limit distributions through 
the diameters e n > 0 of the set con v(&m) is the estimation of r. 


14.4.6 Drift Equations 

To this end, we talked about the support of an individual o;-limit distribution. 
Almost always it is small. But this does not mean, that the union of these 
supports is small even for one solution fi(t). It is possible that a solution is 
a finite set of narrow peaks getting in time more and more narrow, moving 
slower and slower, but not tending to fixed positions, rather continuing to 
move along its trajectory, and the path covered tends to infinity as t —■» oo. 

This effect was not discovered for a long time because the slowing down of 
the peaks was thought as their tendency to fixed positions. There are other 
difficulties related to the typical properties of continuous functions, which are 
not typical for the smooth ones. Let us illustrate them for the distributions 
over a straight line segment. Add to the reproduction coefficients k M the sum 
of small and narrow peaks located on a straight line distant from each other 
much more than the peak width (although it is 5-small). However small is 
chosen the peak’s height, one can choose their width and frequency on the 
straight line in such a way that from any initial distribution /jlq whose support 
is the whole segment, at t —> oc we obtain o;-limit distributions, concentrated 
at the points of maximum of the added peaks. 

Such a model perturbation is small in the space of continuous functions. 
Therefore, it can be put as follows: by small continuous perturbation the 
limit behavior of system (If.45) can be reduced onto a e-net for sufficiently 
small s. But this can not be done with the small smooth perturbations (with 
small values of the first and the second derivatives) in the general case. The 
discreteness of the net, onto which the limit behavior is reduced by small 
continuous perturbations, differs from the discreteness of the support of the 
individual cj-limit distribution. For an individual distribution the number of 
points is estimated, roughly speaking, by the number of essential parameters 
(14.56), while for the conjunction of limit supports - by the number of stages 
in approximation of k M by piece-wise constant functions. 

Thus, in a typical case the dynamics of systems (14.45) with smooth 
reproduction coefficients transforms a smooth initial distributions into the 
ensemble of narrow peaks. The peaks become more narrow, their motion 
slows down, but not always they tend to fixed positions. 
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The equations of motion for these peaks can be obtained in the following 
way [115]. Let X be a domain in the n-dimensional real space, and the initial 
distributions /io be assumed to have smooth density. Then, after sufficiently 
large time £, the position of distribution peaks are the points of the aver¬ 
age reproduction coefficient maximum {k^)t (14.52) to any accuracy set in 
advance. Let these points of maximum be and 

a _ . d 2 (kfj,)t 

ij dx i dx 3 x = x « ' 

It is easy to derive the following differential relations 




dxl 

d t 


dgg 
d t 


dxi 


X = X a 


d%^t) 

dxidxj 


x=x a 


(14.62) 


These relations do not form a closed system of equations, because the right- 
hand parts are not functions of xf and q£j. For sufficiently narrow peaks 
there should be separation of the relaxation times between the dynamics 
on the support and the dynamics of the support: the relaxation of peak 
amplitudes (it can be approximated by the relaxation of the distribution 
with the finite support, {x a }) should be significantly faster than the motion 
of the locations of the peaks, the dynamics of {x a }. Let us write the first 
term of the corresponding asymptotics [115]. 

For the finite support {x a } the distribution is /i = N a S(x — x a ). 
Dynamics of the finite number of variables, N a obeys the system of ordinary 
differential equations 

d/V 

=k a (N)N a , (14.63) 

where N is vector with components N a , k a (N) is the value of the reproduc¬ 
tion coefficient k M at the point x a : 


k a (N) = k„(x a ) ioin = J2 N a 5(x - x a ) . 

Oi 


Let the dynamics of the system (14.63) for a given set of initial conditions 
be simple: the motion N(t) goes to the stable fixed point N = A/"*({x a }). 
Then we can take in the right hand side of (14.62) 


Kt) = = E N *^ x - • ( 14 - 64 ) 

Oi 

Because of the time separation we can assume that (i) relaxation of the 
amplitudes of peaks is completed and (ii) peaks are sufficiently narrow, hence, 
the difference between true k^ and the reproduction coefficient for the 
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measure (14.64) with the finite support {x a } is negligible. Let us use the 
notation k*({x a })(x) for this reproduction coefficient. The relations (14.62) 
transform into the ordinary differential equations 




dxl 

d t 


d t 


dk*({xP})(x) 


dxi 

d 2 k*({xP})(x) 


dxidxj 


(14.65) 


For many purposes it may be useful to switch to the logarithmic time r = In t 
and to new variables 


b a . = -q a = 

n i Vii 


For large t we obtain from (14.65) 


d 2 (k(n)) t 


dxidxj 


\- h a^l = dk*{{ X P}){x) 

dT 

3 


d b\ 


13 

dr 


dxi 

d 2 k* ({x a })(x) 


dx^Xj 


- b\ 


13 


(14.66) 


The way of constructing the drift equations (14.65,14.66) for a specific system 
(14.45) is as follows: 

1. For finite sets {x a } one studies systems (14.63) and finds the equilibrium 
solutions N*({x a }); 

2. For given measures /i*({x a (t)}) (14.64) one calculates the reproduction 
coefficients k^(x) = k*({x a })(x) and first derivatives of these functions in 
x at points x a . That is all, the drift equations (14.65,14.66) are set up. 

The drift equations (14.65,14.66) describe the dynamics of the peaks posi¬ 
tions x a and of the coefficients qfy For given x a , qfj and N* the distribution 
density /i can be approximated as the sum of narrow Gaussian peaks: 




I det Q° 

( 27 r) n 


exp 


-9 J2 q ij( Xi ~ x °j 


(14.67) 


where Q a is the inverse covariance matrix (q^). 

If the limit dynamics of the system (14.63) for finite supports at t —► 00 
can be described by a more complicated attractor, then instead of reproduc¬ 
tion coefficient k*({x a })(x) = k for the stationary measures /i* (14.64) one 
can use the average reproduction coefficient with respect to the corresponding 
Sinai-Ruelle-Bowen measure [396,397]. If finite systems (14.63) have several 
attractors for given {x a }, then the dependence k*({x a }) is multi-valued, and 
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there may be bifurcations and hysteresis with the function k*({x a }) transi¬ 
tion from one sheet to another. There are many interesting effects concerning 
peaks’ birth, desintegration, divergence, and death, and the drift equations 
(14.65,14.66) describe the motion in a non-critical domain, between these 
critical effects. 

Inheritance (conservation of support) is never absolutely exact. Small 
variations, mutations, immigration in biological systems are very important. 
Excitation of new degrees of freedom, modes diffusion, noise are present in 
physical systems. How does small perturbation in the inheritance affect the 
effects of selection? The answer is usually as follows: there is such a value of 
perturbation of the right-hand side of (14.45), at which they would change 
nearly nothing, just the limit ^-shaped peaks transform into sufficiently nar¬ 
row peaks, and zero limit of the velocity of their drift at t —> oo substitutes 
by a small finite one. 

The simplest model for “inheritance + small variability” is given by a 
perturbation of (14.45) with diffusion term 

^ X „(*,<) • (14.68) 

ij * J 


where e > 0 and the matrix of diffusion coefficients d{j is symmetric and 
positively definite. 

There are almost always no qualitative changes in the asymptotic behav¬ 
iour, if 6 is sufficiently small. With this the asymptotics is again described 
by the drift equations (14.65, 14.66), modified by taking into account the 
diffusion as follows: 




dxf 

d t 


d <?g 

d t 


dk* ({x l3 })(x) 


dxi 

d 2 k*{{x 0 }){x) 


dxidx. 


-2e 5? Qik d ki ( x a )qij ■ (14.69) 


kl 


Now, as distinct from (14.65), the eigenvalues of the matrices Q a = (gg) 
cannot grow infinitely. This is prevented by the quadratic terms in the right- 
hand side of the second equation (14.69). 

Dynamics of (14.69) does not depend on the value e > 0 qualitatively, 
because of the obvious scaling property. If e is multiplied by a positive number 
z/, then, upon rescalling t' = v~ x ! 2 t and gg' = z/ -1 / 2 gg, we have the same 
system again. Multiplying e > 0 by v > 0 changes only peak’s velocity values 
by a factor zW 2 , and their width by a factor z/ 1 / 4 . The paths of peaks’ motion 
do not change at this for the drift approximation (14.69) (but the applicability 
of this approximation may, of course, change). 
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14.4.7 Three Main Types of Stability 

Stable steady-state solutions of equations of the form (14.45) may be only the 
sums of ^-functions - this was already mentioned. There is a set of specific 
conditions of stability, determined by the form of equations. 

Consider a stationary distribution for (14.45) with a finite support 

^(x) = J2K^-x* a ). 


Steady state of fi* means, that 

k^(x* a ) = 0 for alio . (14.70) 

The internal stability means, that this distribution is stable with respect 
to perturbations not increasing the support of /i*. That is, the vector N* 
is the stable fixed point for the dynamical system (14.63). Here, as usual, 
it is possible to distinguish between the Lyapunov stability, the asymptotic 
stability and the first approximation stability (negativeness of real parts for 
the eigenvalues of the matrix dN*/dN* at the stationary points). 

The external stability means stability to an expansion of the support, i.e. 
to adding to fi* of a small distribution whose support contains points not be¬ 
longing to supp/i*. It makes sense to speak about the external stability only 
if there is internal stability. In this case it is sufficient to restrict ourselves 
with ^-functional perturbations. The external stability has a very transpar¬ 
ent physical and biological sense. It is stability with respect to introduction 
into the systems of a new inherited unit (gene, variety, specie...) in a small 
amount. 

The necessary condition for the external stability is: the points {x* a } are 
points of the global maximum of the reproduction coefficient k /Jj *(x). It can 
be formulated as the optimality principle 

k fl *(x) < 0 for all x ; k^*(x* a ) = 0 . (14.71) 

The sufficient condition for the external stability is: the points {x* a } and only 
these points are points of the global maximum of the reproduction coefficient 
k (x* a ). At the same time it is the condition of the external stability in the 
first approximation and the optimality principle 

V (x) < 0 for X £ {x* a }; V (x* a ) = 0 . (14.72) 

The only difference from (14.71) is the change of the inequality sign from 
k /Jb *{x) < 0 to k^*(x) < 0 for x ^ {x* a }. The necessary condition (14.71) 
means, that the small ^-functional addition will not grow in the first approx¬ 
imation. According to the sufficient condition (14.72) such a small addition 
will exponentially decrease. 
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If X is a finite set then the combination of the external and the inter¬ 
nal stability is equivalent to the standard stability for a system of ordinary 
differential equations. 

For the continuous X there is one more kind of stability important from 
the applications viewpoint. Substitute (5-shaped peaks at the points {x* a } by 
narrow Gaussians and shift slightly the positions of their maxima away from 
the points x* a . How will the distribution from such initial conditions evolve? 
If it tends to /i without getting too distant from this steady state distribution, 
then we can say that the third type of stability - stable realizability - takes 
place. It is worth mentioning that the perturbation of this type is only weakly 
small, in contrast to perturbations considered in the theory of internal and 
external stability. Those perturbations are small by their norms 6 . 

In order to formalize the condition of stable realizability it is convenient 
to use the drift equations in the form (14.66). Let the distribution fi* be 
internally and externally stable in the first approximations. Let the points x* a 
of global maxima of k(x) be non-degenerate in the second approximation. 
This means that the matrices 



(14.73) 


are strictly positively definite for all a. 

Under these conditions of stability and non-degeneracy the coefficients of 
(14.66) can be easily calculated using Taylor series expansion in powers of 
(x a — x* a ). The stable realizability of /i* in the first approximation means 
that the fixed point of the drift equations (14.66) with the coordinates 



(14.74) 


is stable in the first approximation. It is the usual stability for the system 
(14.66) of ordinary differential equations. 

14.4.8 Main Results About Systems with Inheritance 

1. If a kinetic equation has the quasi-biological form (14.45) then it has a 
rich system of invariant manifolds: for any closed subset A C X the set 
of distributions Ma = {/a | supp// C A} is invariant with respect to 
the system (14.45). These invariant manifolds form important algebraic 
structure, the summation of manifolds is possible: 

MA 0 MB = MauB • 

(Of course, Mahb = Ma H M b ). 

6 Let us remind that the norm of the measure y is ||/i|| = supij| <1 //[/]. If one shifts 
the ^-measure of unite mass by any nonzero distance e, then the norm of the 
perturbation is 2. Nevertheless, this perturbation weakly tends to 0 with e —> 0. 
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2. Typically, all the o;-limit points belong to invariant manifolds Ma with 
finite A. The finite-dimensional approximations of the reproduction coef¬ 
ficient (14.56) provides the minimax estimation of the number of points 
in A. 

3. For systems with inheritance (14.45) a solution typically tends to be a 
finite set of narrow peaks getting in time more and more narrow, moving 
slower and slower. It is possible that these peaks do not tend to fixed 
positions, rather they continue moving, and the path covered tends to 
infinity at t —» oo. This is the drift effect. 

4. The equations for peak dynamics, the drift equations, (14.65,14.66,14.69) 
describe dynamics of the shapes of the peaks and their positions. For sys¬ 
tems with small variability (“mutations”) the drift equations (14.69) has 
the scaling property: the change of the intensity of mutations is equivalent 
to the change of the time scale. 

5. Three specific types of stability are important for the systems with inher¬ 
itance: internal stability (stability with respect to perturbations without 
extension of distribution support), external stability (stability with re¬ 
spect to small one-point extension of distribution support), and stable 
realizability (stability with respect to weakly small 7 perturbations: small 
extensions and small shifts of the peaks). 

Some exact results of the mathematical selection theory can be found 
in [402,403]. There exist many physical examples of systems with inheritance 
[385-391]. A wide field of ecological applications was described in the book 
[383]. An introduction into adaptive dynamics was given in notes [404] that 
illustrate largely by way of examples, how standard ecological models can 
be put into an evolutionary perspective in order to gain insight in the role 
of natural selection in shaping life history characteristics. The cell division 
self-synchronization below demonstrates effects of unusual inherited unit, it 
is the example of a “phase selection”. 


14.5 Example: Cell Division Self-Synchronization 

The results described above admit for a whole family of generalizations. In 
particular, it seems to be important to extend the theorems of selection to 
the case of vector distributions, when k^(x) is a linear operator at each fi,x. 
It is possible also to make generalizations for some classes of non-autonomous 
equations with explicit dependencies of k fl (x) on t. 

Availability of such a network of generalizations allows to construct the 
reasoning as follows: what is inherited (i.e. for what the law of conservation of 
support holds) is the subject of selection (i.e. with respect to these variables 
at t —> oc the distribution becomes discrete and the limit support can be 
described by the optimality principles). 

7 That is, small in the weak topology. 
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This section gives a somewhat unconventional example of inheritance and 
selection, when the reproduction coefficients are subject additional conditions 
of symmetry. 

Consider a culture of microorganisms in a certain medium (for example, 
pathogenous microbes in the organism of a host). Assume, for simplicity, the 
following: let the time period spent by these microorganisms for the whole life 
cycle be identical 

At the end of the life cycle the microorganism disappears and new several 
microorganisms appear in the initial phase. Let T be the time of the life 
cycle. Each microorganism holds the value of the inherited variable, it is “the 
moment of its appearance (mod T)”. Indeed, if the given microorganism 
emerges at time r (0 < r < T), then its first descendants appear at time 
T + r, the next generation - at the moment 2 T + r, then 3 T + r and so on. 

It is natural to assume that the phase r (mod T) is the inherited vari¬ 
able. This implies selection of phases and, therefore, survival of their discrete 
number ti, ... r m , only. But results of the preceding sections cannot be ap¬ 
plied directly to this problem. The reason is the additional symmetry of the 
system with respect to the phase shift. But the typicalness of selection and 
the instability of the uniform distribution over the phases r (mod T) can be 
shown for this case, too. Let us illustrate it with the simplest model. 

Let the difference between the microorganisms at each time moment be 
related to the difference in the development phases only. Let us also assume 
that the state of the medium can be considered as a function of the distribu¬ 
tion g(r) of microorganisms over the phases r E]0, T] (the quasi-steady state 
approximation for the medium). Consider the system at discrete times nT 
and assume the coefficient connecting /a at moments nT and nT + T to be 
the exponent of the linear integral operator value: 


Mn+l(r) 


Unimex p 


ko ~ f h(r - T')n n (T') At' 

Jo 


(14.75) 


Here, g n (r) is the distribution at the moment nT, fco = const, fci(r) is a 
periodic function of period T. 

The uniform steady-state g* = n* = const is: 


hp 

Jo h(6) AO ' 


(14.76) 


In order to examine stability of the uniform steady state g* (14.76), the 
system (14.75) is linearized. For small deviations Ag(r) in linear approxima¬ 
tion 


Ag n+1 (r) = Ag n (r) - n* [ k^r - T')Ag n (r') dr' . (14.77) 

Jo 


Expand k\(0) into the Fourier series: 
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km 



+ b n cos 



(14.78) 


Denote by A operator of the right-hand side of (14.77). 
functions 


e s „ = sin 



n — COS 



In the basis of 


on the segment ]0, T] the operator A is block-diagonal. The vector eo is eigen¬ 
vector, Ae o = Aoeo, Ao = 1 — n*b$T. On the two-dimensional space, generated 
by vectors e sn , e cn the operator A is acting as a matrix 


1 - ^—b 

A — I 1 2 Un 

lH — 1 Tn* „ 


-TlAn 

2 

l _ IiAh 
2 Un 


The corresponding eigenvalues are 


Tn * 

An 1,2 — 1 ^ ipn A ^n) 


(14.79) 


(14.80) 


For the uniform steady state //* (14.76) to be unstable it is sufficient 
that the absolute value of at least one eigenvalue A n i ? 2 be larger than 1: 
|A n i, 2 | > 1- If there is at least one negative Fourier cosine-coefficient b n < 0, 
then ReA n > 1, and thus |A n | > 1. 

Note now, that almost all periodic functions (continuous, smooth, analyt¬ 
ical - this does not matter) have negative Fourier cosine-coefficient. This can 
be understood as follows. The sequence b n tends to zero at n —> oc. There¬ 
fore, if all b n > 0, then, by changing b n at sufficiently large n, we can make b n 
negative, and the perturbation value can be chosen less than any previously 
set positive number. On the other hand, if some b n < 0, then this coefficient 
cannot be made non-negative by sufficiently small perturbations. Moreover, 
the set of functions that have all Fourier cosine-coefficient non-negative is 
completely thin, because for any compact of functions K (for most of norms 
in use) the sequence B n = ma ^feK \b n (f)\ tends to zero, where b n (f) is the 
nth Fourier cosine-coefficient of function /. 

The model (14.75) is revealing, because for it we can trace the dynamics 
over large times, if we restrict ourselves with a finite segment of the Fourier 
series for /q($). Describe it for 


k\(6) = bo + a sin 



+ b cos 



(14.81) 


Assume further that b < 0 (then the homogeneous distribution n* = ^ is 
unstable) and bo > V a 2 + b 2 (then the J /i(r) dr cannot grow unbounded in 
time). Introduce notations 
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r T r T 

Md(m) = J M T ) dr, M c (ji) = J cos (2 /i(r) dr , 

f T T 1 U ~ 1 

M s (n) = / sin (2?T) /z(r) dr, (/z) n = - ^ Mm , (14.82) 

71 m=0 


where is the distribution /i at the discrete time m. 
In these notations, 


Mn+i( r ) = fi n (r)exp k 0 - b 0 M 0 (iJ, n ) - (aM c (fi n ) + bM s (/i n )) sin ( 271 -^) 


+{aM s (fi n ) - bM c (/j, n )) cos ( 277 1;) 


(14.83) 


Represent the distribution fi n (r) through the initial distribution Ho(t) and 
the functionals M 0 ,M C ,M S values for the average distribution (//) n ): 


Hn{r) = yuo(r) 

x exp jn fc 0 - b 0 M 0 ((iJ,)n) ~ (oM c ((/u)„) + 6M s ((/z)„)) sin ( 277 ^) 
+(aM s ((/i) n )-bM c ((/i) n )) cos (2n^ j. (14.84) 


The exponent in (14.84) is either independent of r, or there is a function 
with the single maximum on ]0,T]. The coordinate r if of this maximum is 
easily calculated 


.# _ o rr f an a M c ({^)n) + bM s (([l) n ) 

n 27t aM s ((/i) n )-5M c ((/i) n ) 


(14.85) 


Let the non-uniform smooth initial distribution /jlq has the whole seg¬ 
ment [0,T] as its support. At the time progress the distributions /i n (r) takes 
the shape of ever narrowing peak. With high accuracy at large a we can 
approximate fi n (r) by the Gaussian distribution (approximation accuracy is 
understood in the weak sense, as closeness of mean values): 


Hn(r) « M 0] J^ exp[-q n (T - t*) 2 ], M 0 = = AqL_ ) (14.86) 

Q 2 n = n 2 (^f) [K((mW + bM s ((v) n )) 2 + (aM B ((tt) n ) - bM c (( M ) n )) 2 ] . 

Expression (14.86) involves the average measure (fi) n which is difficult to 
compute. However, we can operate without direct computation of (/i) n . At 
Qn ^ 7^2 we can compute q n +i and r^_ 1 : 


Vn+t « M ^^ exp [~(q n + Aq)({r - t* - At*) 2 } , 

At* rTmoA . 

y 2 V T / q T 


(14.87) 
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The accuracy of these expression grows with time n. The value q n grows 
at large n almost linearly, and r#, respectively, as the sum of the harmonic 
series (mod T), i.e. as In n (mod T). The drift effect takes place: location of 
the peak t* , passes at n — ■> oc the distance diverging as Inn. 

Of interest is the case, when b > 0 but 

|Ai| 2 = (l + n*b^j +(n*a' 1 pj >1. 


With this, homogeneous distribution /i* = n* is not stable but fi does not 
tend to ^-functions. There are smooth stable “self-synchronization waves” of 
the form 


Hn = 7 ex P 


geos 


(V - nz\r *)y^) 


At small 6 > 0 (b -C |a|, 6Mo C fl 2 ) we can find explicit form of approximated 
expressions for g and Ar^\ 


q « 


a 2 Mo 
2 b 


At* 


bT 

7TCL 


(14.88) 


At b > 0, b —> 0, smooth self-synchronization waves become ever narrow¬ 
ing peaks, and their steady velocity approaches zero. If b = 0, |Ai| 2 > 1 then 
the effect of selection takes place again, and for almost all initial conditions 
Ho with the support being the whole segment [0, T] the distribution fin takes 



Fig. 14.1. The simplest model of cell division self-synchronization: The parametric 
portrait 
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at large n the form of a slowly drifting almost Gaussian peak. It becomes nar¬ 
rower with the time, and the motion slows down. Instead of the linear growth 
of q n which takes place at b < 0 (14.87), for b = 0, q n +i — Qn ~ constg” 1 and 
q n grows as const y/n. 

The parametric portrait of the system for the simple reproduction coeffi¬ 
cient (14.81) is presented in Fig. 14.1. 

As usual, a small desynchronization transforms ^-functional limit peaks to 
narrow Gaussian peaks, and the velocity of peaks tends to small but nonzero 
velocity instead of zero. The systems with small desynchronization can be 
described by equations of the form (14.69). 

There are many specific mechanisms of synchronization and desynchrony- 
sation in physics and biology (see, for example [405-409]). We described here 
very simple mechanism: it requires only that the time of the life cycle is fixed, 
in this case in a generic situation we should observe the self-synchronization. 
Of course, the real-world situation can be much more complicated, with a 
plenty of additional factors, but the basic mechanism of the “phase selec¬ 
tion” works always if the life cycle has more or less fixed duration. 


15 Accuracy Estimation and Post-Processing 
in Invariant Manifolds Construction 


The post-processing algorithms are developed for the accuracy control and 
enhancement of approximate invariant manifold. 


15.1 Formulas for Dynamic and Static Post-Processing 


Assume that for the dynamical system (3.1) 


dx 
d t 


J(x) 


an approximate invariant manifold is constructed and the slow motion equa¬ 
tions are derived: 

^ = P, sl (J(x sl )),x sl e/2 sl . (15.1) 

Here, P Xgl is the projector onto the tangent space T Xsl of !? s i parallel to the 
plain of fast motions. Suppose that we have solved the system (15.1) and 
have obtained x s \(t). Let us consider the following two questions: 

How well this solution approximates the true solution x(t) with the same 

initial condition? 

- Is it possible to use the solution x s \(t) for its refinement? 

It should be stressed that these questions can be asked only if the slow 
system (15.1) is obtained as a result of reduction, that is, with the help of 
the projector P Xal that identifies fast fibers (kerP^J. These question are 
meaningless if “some” closure approximation is used without a specification 
what means “fast” and “slow” in this approximation. In the latter case one 
can only hope that the closure is a good guess, that it is thermodynamically 
consistent, etc, but nothing can be done on its refinement. 

These two questions are interconnected. The first question states the 
problem of the accuracy estimation. The second states the problem of post¬ 
processing [348-351]. 

The simplest (“naive”) estimation is given by the “invariance defect”: 


— (1 Px a i)J( x sl) 5 


(15.2) 
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which can be compared with J(x s \). For example, this estimate is given by 
e = \\A x J/\\J(x sl )\\ using some appropriate norm. 

Probably, the most comprehensive answer to the above questions can be 
given by solving the following equation: 

® = A Xel{t) + D x J(x)\ Xsl{t) 6x . (15.3) 

This linear equation describes the dynamics of the variation Sx(t) = x(t) — 
x s \ (£) in the linear approximation. The solution with zero initial condition 
&r(0) = 0 allows to estimate the robustness of r s i, as well as the error. Using 
x s \(t) + Sx(t) instead of x s \(t) gives the required solution refinement. This 
dynamical post-processing [350] allows to refine the solution substantially. 
However, the price for this is solving equation (15.3) with variable coeffi¬ 
cients. The dynamical post-processing can be addressed by a whole hierarchy 
of simplifications, both dynamic and static. Let us mention some of them, 
starting from the dynamic ones. 

(1) Freezing coefficients. In the equation (15.3) the linear operator 
D x J(x)\ Xsl{t) is replaced by its value in some distinguished point x* (for 
example, in the equilibrium) or it is frozen somehow else. As a result, one gets 
the equation with constant coefficients and the explicit integration formula: 

5x(t)=f exp(D*(t — t))Z\ X bi(t) dr , (15.4) 

J 0 

where D * is the “frozen” operator and &r(0) = 0. 

Another important way of freezing is to replace (15.3) by some model 
equation , i.e. substituting — ^ instead of D x J(x ), where r* is the relaxation 
time. In this case the formula for Sx(t) has a very simple form: 


Sx(t) - I 

J o 


T~t 

e A, 


^sl (t) 


dr 


(15.5) 


(2) One-dimensional Galerkin-type approximation. Another “sca¬ 
lar” approximation is given by projecting (15.3) on A(t) = A Xsl ( t y Using the 
ansatz 


Sx(t) = S(t)A(t) , 


(15.6) 


substituting it into (15.3), and projecting the result orthogonally on A{t) we 
obtain 


cM IA\DA)-(A\A) 

d t (A\A) 


(15.7) 


where (|) is an appropriate scalar product, which can depend on the point 
x s \ (for example, the entropic scalar product), D = D x J(x )| Xsl ( t ) or the self- 
adjoint linearizarion of this operator, or some approximation of it, and A = 
dA(t)/dt. 
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A “hybrid” between equations (15.7) and (15.3) has a rather simple form 
(but it is more difficult for computations than (15.7)): 


d(fe) 
d t 


= A(t) 


(A\DA) 

{A\A) 


Sx 


(15.8) 


Here one uses the normalized matrix element instead of the linear 

operator D = D x J{x)\ Xs y t y 

Both equations (15.7) and (15.8) can be solved explicitly: 



dr exp 


J 

A(r)dTexp^J &i((9)d#^ , 


(15.9) 

(15.10) 


where k(t) = , h (t) = . 

The projection of A Xsl (t) on the slow motion is equal to zero, hence, for the 
post-processing of the slow motion, the one-dimensional model (15.7) should 
be supplemented by one more iteration in order to find the first non-vanishing 
term in 5x s \(t): 


d(< y )} = S(t)P Xslit) (D x J(x)\ Xsl{T) )(A(t)) ; 

Sx s i(t)= f S(T)P Xsl{T) (D x J(x)\ XeliT) )(A(r))dr . (15.11) 

Jo 

where S(t) is the solution of (15.7). 

(3) For a static post-processing, one uses stationary points of dynamic 
equations (15.3), or of their simplified versions (15.4),(15.7). Instead of (15.3) 
one gets: 

D x J(x)\ Xsl(t) Sx = ~A XslW (15.12) 

with the additional condition P Xsl Sx = 0. This is exactly the iteration equa¬ 
tion of the Newton method for solving the invariance equation. A clarification 
is in order here. Static post-processing (15.12) as well as other post-processing 
formulas should not be confused with the Newton method and others for cor¬ 
recting the approximately invariant manifold. Here, only the single trajectory 
x s \(t) on the manifold is corrected, not the whole manifold. 

The corresponding stationary problems for the model equations and for 
the projections of (15.3) on A are obvious. We only mention that in the 
projection on A one gets a step of the relaxation method for the invariant 
manifold construction. 

In the following Example it will be demonstrated how one can use function 
Z\(x s i(t)) in the accuracy estimation of macroscopic equations in the dynamics 
of polymer solution. 








460 15 Accuracy Estimation and Post-Processing 

15.2 Example: Defect of Invariance Estimation 
and Switching from the Microscopic Simulations 
to Macroscopic Equations 

A method which recognizes the onset and breakdown of the macroscopic 
description in microscopic simulations was developed in [29,268,414]. The 
method is based on the invariance of the macroscopic dynamics relative to 
the microscopic dynamics, and it is demonstrated for a model of dilute poly¬ 
meric solutions where it decides switching between Direct Brownian Dynam¬ 
ics simulations and integration of constitutive equations. 

15.2.1 Invariance Principle and Micro-Macro Computations 

Derivation of reduced (macroscopic) dynamics from the microscopic dynam¬ 
ics is the dominant theme of non-equilibrium statistical mechanics. At the 
present time, this very old theme demonstrates new facets in view of a mas¬ 
sive use of simulation techniques on various levels of description. A two-side 
benefit of this use is expected: On the one hand, simulations provide data on 
molecular systems which can be used to test various theoretical constructions 
about the transition from micro to macro description. On the other hand, 
while the microscopic simulations in many cases are based on limit theo¬ 
rems [such as, for example, the central limit theorem underlying the Direct 
Brownian Dynamics simulations (BD)] they are extremely time-consuming 
in any real situation, and a timely recognition of the onset of a macroscopic 
description may considerably reduce computational efforts. 

In this subsection, we aim at developing a ‘device’ which is able to recog¬ 
nize the onset and the breakdown of a macroscopic description in the course 
of microscopic computations. 

Let us first present the main ideas of the construction in an abstract 
setting. We assume that the microscopic description is set up in terms of 
microscopic variables £. In the examples considered below, microscopic vari¬ 
ables are distribution functions over the configuration space of polymers. The 
microscopic dynamics of variables £ is given by the microscopic time deriv¬ 
ative d£/d t = £(£). We also assume that the set of macroscopic variables 
M is chosen. Typically, the macroscopic variables are some lower-order mo¬ 
ments if the microscopic variables are distribution functions. The reduced 
(macroscopic) description assumes (a) The dependence £(AT), and (b) The 
macroscopic dynamics dM/dt = M(M). We do not discuss here in any de¬ 
tail the way one gets the dependence £(Af), however, we should remark that, 
typically, it is based on some (explicit or implicit) idea about decomposition 
of motions into slow and fast, with M as slow variables. With this, such tools 
as maximum entropy principle, quasi-stationarity, cumulant expansion etc. 
become available for constructing the dependence £(Af). 

Let us compare the microscopic time derivative of the function £(M) with 
its macroscopic time derivative due to the macroscopic dynamics: 
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•M(M)-£(£(M)). 


(15.13) 


If the defect of invariance A(M) (15.13) is equal to zero on the set of ad¬ 
missible values of the macroscopic variables M, it is said that the reduced 
description £(M) is invariant. Then the function f(M) represents the invari¬ 
ant manifold in the space of microscopic variables. The invariant manifold is 
relevant if it is stable. Exact invariant manifolds are known in a very few cases 
(for example, the exact hydrodynamic description in the kinetic Lorentz gas 
model [202], in Grad’s systems [40,42], and one more example will be men¬ 
tioned below). Corrections to the approximate reduced description through 
minimization of the defect of invariance is a part of the so-called method 
of invariant manifolds [11]. We here consider a different application of the 
invariance principle for the purpose mentioned above. 

The time dependence of the macroscopic variables can be obtained in two 
different ways: First, if the solution of the microscopic dynamics at time t 
with initial data at to is ^,t 0 , then evaluation of the macroscopic variables on 
this solution gives M™ C J°. On the other hand, solving dynamic equations of 
the reduced description with initial data at to gives ilT™^ cro . Let ||Z\|| be a 
value of defect of invariance with respect to some norm, and e > 0 is a fixed 
tolerance level. Then, if at the time t the following inequality is valid, 



(15.14) 


this indicates that the accuracy provided by the reduced description is not 
worse than the true microscopic dynamics (the macroscopic description sets 
on). On the other hand, if 



(15.15) 


then the accuracy of the reduced description is insufficient (the reduced de¬ 
scription breaks down), and we must use the microscopic dynamics. 

Thus, evaluating the defect of invariance (15.13) on the current solution 
to macroscopic equations, and checking the inequality (15.15), we are able to 
answer the question whether we can trust the solution without looking at the 
microscopic solution. If the tolerance level is not exceeded then we can safely 
integrate the macroscopic equation. We now proceed to a specific example 
of this approach. We consider a well-known class of microscopic models of 
dilute polymeric solutions 

15.2.2 Application to Dynamics of Dilute Polymer Solution 

A well-known problem of the non-Newtonian fluids is the problem of estab¬ 
lishing constitutive equations on the basis of microscopic kinetic equations. 
We here consider a model introduced by Lielens et al. [410]: 
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= -dg | K(t)qf - ^fd q u(q 2 )^ + ^d 2 f . (15.16) 

With the potential U{x) = —(b/2)ln(l — x/b) equation (15.16) becomes the 
one-dimensional version of the FENE dumbbell model which is used to de¬ 
scribe the elongational behavior of dilute polymer solutions. 

The reduced description seeks a closed time evolution equation for the 
stress r = ( qd q U(q 2 )) — l. Due to its non-polynomial character, the stress r for 
the FENE potential depends on all moments of /. We have shown in [411] how 
such potentials can be approximated systematically by a set of polynomial 
potentials U n (x) = \j c j xJ °f degree n with coefficients Cj depending 

on the even moments Mj = (g 2j ) of / up to order n, with n = 1 , 2 ,..., 
formally converging to the original potential as n tends to infinity. In this 
approximation, the stress r becomes a function of the first n even moments 
of /, r(M) = Xq=i CjMj — 1, where the set of macroscopic variables is 
denoted by M = {Mi,..., M n }. 

The first two potentials approximating the FENE potential are: 

Ci(</ 2 ) = U'{Mi)q 2 (15.17) 

u 2 {q 2 ) = \{q A ~ 2 M 1 q 2 )U"(M 1 ) + i (M 2 - M 2 )q 2 U"' , (15.18) 

where I/', U" and U"' denote the first, second and third derivative of the 
potential U, respectively. The potential V\ corresponds to the well-known 
FENE-P model. The kinetic equation (15.16) with the potential U2 (15.18) 
will be termed the FENE-P+1 model below. Direct Brownian Dynamics sim¬ 
ulation (BD) of the kinetic equation (15.16) with the potential U2 for the flow 
situations studied in [410] demonstrates that it is a reasonable approximation 
to the true FENE dynamics whereas the corresponding moment chain is of a 
simpler structure. In [29] this was shown for a periodic flow, while Fig. 15.1 
shows results for the flow 


«w = { 100,(1 


0 < t < 1 ; 
else . 


(15.19) 


The quality of the approximation indeed increases with the order of the poly¬ 
nomial. 

For any potential C7 n , the invariance equation can be studied directly in 
terms of the full set of the moments, which is equivalent to studying the distri¬ 
bution functions. The kinetic equation (15.16) can be rewritten equivalently 
in terms of moment equations, 


Mfc — Fk{Mi ,..., M/~_ |_ n _i) 5 

n 

F k = 2kn(t)M k + k(2k — l)M fc _i — k ^2 CjM k+j _i . 


(15.20) 
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Fig. 15.1. Stress r versus time from direct Brownian dynamics simulation: sym¬ 
bols - FENE, dashed line - FENE-P, solid line - FENE-P+1 


We seek functions M™ acro (iVf), k = n + 1,... which are form-invariant under 
the dynamics: 

n dM ma,cro (M) 

E- k dM = Fk(M u M n+1 (M),..., M n+k (M)) . 

j = 1 3 

(15.21) 

This set of invariance equations states the following: The time derivative of 
the form M™ acro (M) when computed due to the closed equation for M (the 
first contribution on the left hand side of (15.21), or the ‘macroscopic’ time 
derivative) equals the time derivative of M\ as computed by true moment 
equation with the same form (the second contribution, or the ‘mi¬ 

croscopic’ time derivative), and this equality should hold whatsoever values 
of the moments M are. 

Equations (15.21) in case n = 1 (FENE-P) are solvable exactly with the 
result 

M m acr ° = akM k ; with ak = _ i ) ak _^ a 0 = 1 . 

This dependence corresponds to the Gaussian solution in terms of the dis¬ 
tribution functions. As expected, the invariance principle give just the same 
result as the usual method of solving the FENE-P model. 

Let us briefly discuss the potential considering a simple closure ap¬ 
proximation 

M macro( Mi) Ma ) = k + b k M 2 M^~ 2 , (15.22) 















464 


15 Accuracy Estimation and Post-Processing 



Fig. 15.2. Defect of invariance A 3 / 5 3 , (15.23), versus time extracted from BD 
simulation (the FENE-P+1 model) for the flow situation of (15.19) 


where a& = 1 — k(k— 1)/2 and bj, c = k(k — 1)/2. The function M™ acro closes the 
moment equations for the two independent moments Mi and M 2 . Note, that 
M^acro differs from the corresponding moment M 3 of the actual distribution 
function by the neglect of the 6 -th cumulant. The defect of invariance of this 
approximation is a set of functions A^ where 


A 3 (M 1 ,M 2 ) 


dM? acro dM? aci ° 
dM[ Fl + <9M 2 


Fs, 


(15.23) 


and analogously for k > 3. In the sequel, we make all conclusions based on 
the defect of invariance A% (15.23). 

It is instructive to plot the defect of invariance A% versus time, assum¬ 
ing the functions Mi and M 2 are extracted from the BD simulation (see 
Fig. 15.2). We observe that the defect of invariance is a nonmonotonic func¬ 
tion of the time, and that there are three pronounced domains: From to = 0 
to 1 1 the defect of invariance is almost zero which means that the ansatz 
is reasonable. In the intermediate domain, the defect of invariance jumps to 
high values (so the quality of approximation is poor). However, after some 
time t = t*, the defect of invariance again becomes negligible, and remains 
so for later times. Such behavior is typical of so-called “kinetic layer”. 

Instead of attempting to improve the closure, the invariance principle can 
be used directly to switch from the BD simulation to the solution of the 
macroscopic equation without loosing the accuracy to a given tolerance. In¬ 
deed, the defect of invariance is a function of Mi and M 2 , and it can be easily 
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Fig. 15.3. Switching from the BD simulations to macroscopic equations after the 
defect of invariance has reached the given tolerance level (the FENE-P+1 model): 
symbols - the BD simulation, solid line - the BD simulation from time t — 0 up to 
time t = t *, dashed line - integration of the macroscopic dynamics with initial data 
from BD simulation at time t = t*. For comparison, the dot-dashed line gives the 
result for the integration of the macroscopic dynamics with equilibrium conditions 
from t — 0. Inset: Transient dynamics at the switching from BD to macroscopic 
dynamics on a finer time scale 



evaluated both on the data from the solution to the macroscopic equation, 
and the BD data. If the defect of invariance exceeds some given tolerance on 
the macroscopic solution this signals to switch to the BD integration. On the 
other hand, if the defect of invariance becomes less than the tolerance level 
on the BD data signals that the BD simulation is not necessary anymore, 
and one can continue with the integration of the macroscopic equations. This 
reduces the necessity of using BD simulations only to get through the kinetic 
layers. A realization of this hybrid approach is demonstrated in Fig. 15.3: 
For the same flow we have used the BD dynamics only for the first period 
of the flow while integrated the macroscopic equations in all the later times. 
The quality of the result is comparable to the BD simulation whereas the 
total integration time is much shorter. The transient dynamics at the point 
of switching from the BD scheme to the integration of the macroscopic equa¬ 
tions (shown in the inset in Fig. 15.3) deserves a special comment: The initial 
conditions at t* are taken from the BD data. Therefore, we cannot expect 
that at the time t* the solution is already on the invariant manifold, rather, 
at best, close to it. Transient dynamics therefore signals the stability of the 
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invariant manifold we expect: Even though the macroscopic solution starts 
not on this manifold, it nevertheless attracts to it. The transient dynam¬ 
ics becomes progressively less pronounced if the switching is done at later 
times. The stability of the invariant manifold in case of the FENE-P model 
is studied in detail in [109]. 

The present approach of combined microscopic and macroscopic simu¬ 
lations can be realized on the level of moment closures (which then needs 
reconstruction of the distribution function from the moments at the switch¬ 
ing from macroscopic integration to BD procedures), or for parametric sets of 
distribution functions if they are available [410]. It can be used for a rigorous 
construction of domain decomposition methods in various kinetic problems. 


16 Conclusion 


it is useful to construct slow invariant manifolds. Effective model 
reduction becomes unfeasible without them for complex kinetic systems. 

Why should we attempt to reduce the description in the times of super¬ 
computers? 

First, in order to gain insight. In the process of reducing the description we 
is often able to extract the essential, and the mechanisms of the processes 
under study become more transparent. 

- Second, once we obtain the detailed description of the system, then we 
can try to solve the initial-value problem for this system. But what should 
one do in the case where the system represents just a small part of the 
huge number of interacting systems? For example, a complex chemical 
reaction system may represent just a point in a three-dimensional flow. 

- Third, without reducing the kinetic model, it is impossible to construct 
this model. This statement seems paradoxical only at the first glance: How 
can it come, the model is first simplified, and is constructed only after the 
simplification is done? However, in practice, the statement of the problem 
typical for a mathematician (Let the system of differential equations be 
given , then ...) is rather rarely applicable for detailed kinetics. On the 
contrary, the thermodynamic data (energies, enthalpies, entropies, chemi¬ 
cal potentials etc) for sufficiently rarefied systems are quite reliable. Final 
identification of the model is always done on the basis of comparison with 
the experiment and with the help of fitting. For this purpose, it is ex¬ 
tremely important to reduce the dimension of the system, and to reduce 
the number of tunable parameters. 

And, finally, for every supercomputer there exist problems that are too 
complicated. Model reduction makes these problems less complicated and 
sometimes gives us the possibility to solve them. 

It is useful to apply thermodynamics and the quasiequilibrium 
concept while seeking slow invariant manifolds. Although open sys¬ 
tems are important for many applications, it is useful to begin their study 
and model reduction with the analysis of closed (sub)systems. The thermody¬ 
namics equips then these systems with the Lyapunov functions (entropy, free 
energy, free enthalpy, depending on the context). These Lyapunov functions 
are usually known much better than the right hand sides of kinetic equations 
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(in particular, this is the case in reaction kinetics). Using a Lyapunov func¬ 
tion, one constructs the initial approximation to the slow manifold, that is, 
the quasiequilibrium manifold, and also one constructs the thermodynamic 
projector. 

The thermodynamic projector is the unique operator which trans¬ 
forms the arbitrary vector field equipped with the given Lyapunov function 
into a vector field with the same Lyapunov function (and also this happens 
on any manifold which is not tangent to the level of the Lyapunov function). 

The quasi-chemical approximation is an extremely rich toolbox for 
assembling equations. It enables one to construct and study wide classes of 
evolution equations equipped with prescribed Lyapunov functions and On- 
sager reciprocity relations. 

The method of natural projector is an attractive method of model 
reduction for dissipative systems, and at the same time it gives a clue to the 
problem of irreversibility. The formula for entropy production , 

defect of invariance 

a rsj - 

curvature 

clarifies the geometrical sense of the dissipation. Here, “defect of invariance” 
is the defect of invariance of the quasiequilibrium manifold, and “curvature” 
is the curvature of the film of nonequilibrium states in the direction of 
the defect of invariance of the quasiequilibrium manifold 

Slow invariant manifolds of thermodynamically closed systems are useful 
for constructing slow invariant manifolds of the corresponding open systems. 
The necessary technique is developed. 

The /^-contractions and the quasi-biological representation allow to 
find finite-dimensional asymptotics for some of infinite-dimensional systems. 

The postprocessing of the invariant manifold construction is important 
both for the estimation of the accuracy and for the accuracy improvement. 

The main result of this book can be formulated as follows: It is possible 
indeed to construct invariant manifolds. The problem of constructing 
invariant manifolds can be formulated as the invariance equation, subject to 
additional conditions of slowness (stability). The Newton method with in¬ 
complete linearization, relaxation methods, the method of natural projector, 
and the method of invariant grids enables educated approximations to the 
slow invariant manifolds. These methods were tested on a recently discovered 
class of exactly solvable reduction problems. 

It becomes more and more evident at the present time that the construc¬ 
tive methods of invariant manifold are useful for a wide range of subjects, 
spanning from applied hydrodynamics to physical and chemical kinetics. 
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Mathematical Notation and Some Terminology 


- The operator L from space W to space E: L : W —> E. 

- The kernel of a linear operator L : W —> E is a subspace ker L cW that 
transforms by L into 0: kerL = {iG W\Lx = 0}. 

- The image of a linear operator L : W —> E is a subspace imP = L(W ) C 
E. 

- Projector is a linear operator P : E —> E with the property P 2 = P. 
Projector P is orthogonal one, if ker PTimP (the kernel of P is orthogonal 
to the image of P). 

- If F : V —> V is a map of domains in normed spaces (U C W, V C E) then 
the differential of F at a point x is a linear operator D X F : W —* E with 
the property: || F(x + 5x) — F(x) — (D x F)(Sx )|| = o(||&r||). This operator 
(if it exists) is the best linear approximation of the map F(x-\-Sx) — F(x). 

- The differential of the function f{x) is the linear functional D x f. The 
gradient of the function f(x) can be defined, if there is a given scalar 
product (|), and if there exists a Riesz representation for functional D x f: 
(. D x f)(a ) = (grad^/la). The gradient grad x f is a vector. 

The second differential of a map F : U —> V is a bilinear operator D 2 F : 
W x W —> E which can be defined by Taylor formula: F(x + 5x) = 
F(x) + ( D x F)(Sx ) + l(D 2 F)(6x,6x) +o(\\5x\\ 2 ). 

- The differentiable map of domains in normed spaces F : U —» V is an 
immersion , if for any x G U the operator D X F is injective: ker D X F = {0}. 
In this case the image of F (i.e. F(U )) is called the immersed manifold , and 
the image of D X F is called the tangent space to the immersed manifold 
F(U). We use the notation T x for this tangent space: imD x F = T x . 

The subset U of the vector space E is convex , if for every two points 
Xi,X 2 G U it contains the segment between x\ and x 2 : \xi~\-(l — X)x 2 G U 
for every A G [0,1]. 

The function /, defined on the convex set V C P, is convex , if its epigraph , 
i.e. the set of pairs Epi/ = {(x,g)\x G U,g > f(x)}, is the convex set in 
E x R. The twice differentiable function / is convex if and only if the 
quadratic form ( D 2 f)(Sx,Sx ) is nonnegative. 

- The convex function / is called strictly convex if in the domain of definition 
there is no line segment on which it is constant and finite (f(x) = const 7 ^ 
00 ). The sufficient condition for the twice differentiable function / to be 
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strictly convex is that the quadratic form (D%f)(Sx, Sx ) is positive defined 
(i.e. it is positive for all Sx ^ 0). 

- We use summation convention for vectors and tensors, = 'YhiCiQu 
when it cannot cause a confusion, in more complicated cases we use the 
sign y. 
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